-- Logs begin at Fri 2022-09-30 08:51:14 UTC, end at Fri 2022-09-30 09:51:40 UTC. -- Sep 30 09:24:12.201778 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 30 09:24:12.209802 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 09:24:12 2022] *** Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: nodename: dv-osbrick-master-4-iscsi Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: machine: x86_64 Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: clock source: unix Sep 30 09:24:12.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: pcre jit disabled Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: detected number of CPU cores: 4 Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: current working directory: / Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: detected binary path: /usr/bin/uwsgi-core Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: your processes number limit is 47680 Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: your memory page size is 4096 bytes Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: detected max file descriptor number: 2048 Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: lock engine: pthread robust mutexes Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: thunder lock: enabled Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 30 09:24:12.212254 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 09:24:12.252290 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: Python main interpreter initialized at 0x55ac490279c0 Sep 30 09:24:12.252290 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: python threads support enabled Sep 30 09:24:12.252290 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: your server socket listen backlog is limited to 100 connections Sep 30 09:24:12.252290 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: your mercy for graceful operations on workers is 90 seconds Sep 30 09:24:12.252671 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 09:24:12.252761 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: *** Operational MODE: preforking *** Sep 30 09:24:12.253010 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: *** uWSGI is running in multiple interpreter mode *** Sep 30 09:24:12.253010 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: spawned uWSGI master process (pid: 81479) Sep 30 09:24:12.253230 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 30 09:24:12.254860 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: spawned uWSGI worker 1 (pid: 81493, cores: 1) Sep 30 09:24:12.254860 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: spawned uWSGI worker 2 (pid: 81494, cores: 1) Sep 30 09:24:12.254860 dv-osbrick-master-4-iscsi devstack@keystone.service[81479]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 09:24:16.514780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:24:16.514780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: from cryptography.utils import int_from_bytes Sep 30 09:24:16.515606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:24:16.515606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: from cryptography.utils import int_from_bytes Sep 30 09:24:16.515726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:24:16.515726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: from cryptography.utils import int_from_bytes Sep 30 09:24:16.515726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:24:16.515726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: from cryptography.utils import int_from_bytes Sep 30 09:24:16.565402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:24:16.565598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:24:16.565789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] command line args: [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:24:16.566058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:24:16.566262 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ================================================================================ {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:24:16.566517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] admin_token = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.566597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:24:16.566719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:24:16.566805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] config_dir = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.566909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] command line args: [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:24:16.566993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] config_source = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:24:16.567273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] debug = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ================================================================================ {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:24:16.567471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] admin_token = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] config_dir = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567860 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.567983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] config_source = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] debug = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.568924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_config_append = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_dir = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_file = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.569904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_config_append = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570013 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_dir = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_file = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570736 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.570938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571325 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.571962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572736 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.572872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] publish_errors = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573593 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.573821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] publish_errors = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] standard_threads = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.574992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] use_journal = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.575987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] standard_threads = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] use_json = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] use_stderr = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] use_syslog = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] use_journal = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.576836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] use_json = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] use_stderr = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.576972 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] use_syslog = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.577118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:24:16.577303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577795 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.577939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578745 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578892 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.578977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.579983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580095 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.580897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.581916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.582856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.583938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.584958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.585909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586060 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.586976 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.587958 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588797 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.588907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.589960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590285 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590362 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.590910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.591937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.592969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593716 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593871 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.593964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.594875 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.595952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.596950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.597099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.597179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.597887 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.597985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598753 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.598900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.599968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.600958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.external = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.601924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602336 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602417 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.external = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.602880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.password = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603027 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] auth.token = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.password = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.603974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] auth.token = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604754 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.604981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605146 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605413 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.605953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.606928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607546 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607628 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.607874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608273 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.608865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609297 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609536 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.609849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.610950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.611977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612521 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612669 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.612910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.613643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.613749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.613882 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.613962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.614889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615593 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.615965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.616986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.617933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.618968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.619967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.620991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.621885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.622921 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.623959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.624881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625295 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.625946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626322 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.626959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627095 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.627986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.628896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629573 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.629964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.630885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631535 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.631920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632452 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.632973 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633795 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.633920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.634944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635328 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635706 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.635968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.636879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] role.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] role.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.637977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] role.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] role.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.638863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639228 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639352 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.639990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.640984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641231 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.641981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642270 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642350 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.642946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.643973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644416 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644786 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.644937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645011 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.645927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646144 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.646876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647537 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.connection = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.647876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.connection = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648751 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648832 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.648985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.649932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.650950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651461 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651875 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.651948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:24:16.652033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.652245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:24:16.652412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:24:16.681238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.681437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.681664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.681840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.682072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.682298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.690038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.690515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.719093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.719298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.719529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.771944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.772243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.821128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.821383 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.822164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.822398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.976973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.977523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:16.999952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000711 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000844 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.000928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.001062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.001148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.001295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.001382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.001543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.012307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.012544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.025570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.025797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.025886 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.026955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.027074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:24:17.043960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.044106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.044191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:24:17.044314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:24:17.044495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.044651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.044748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:24:17.044854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:24:17.044939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.045906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055414 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.055959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.056102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.056243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.063056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.063239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.065976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.066140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.066289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.066422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.066574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.066701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.066858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.066978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067142 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.067952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068576 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.068841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.091648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.091745 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.093113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.093198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.093422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.093508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.098259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.098540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.098817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.099062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.099349 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.099632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.105207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.105515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.106004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.106298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.111316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.111619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.111905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.112186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.112457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.112539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.112727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.112810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.113532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.113621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.113800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.113896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.114142 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.114416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.114688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.114959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.129573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.129844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.131309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.131590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.133627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.135456 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.136767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.137059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.138979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.139276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.141463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.144636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.146665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.147825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.148121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.148405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.148687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.148977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.149284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.149909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.150210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.150498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.150785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.151065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.151355 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.164879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.165165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.165458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.165723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.167108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.167397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.167666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.167930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.172482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.174031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.174770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.176049 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.176321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.176820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.178371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.178649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.179060 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.179344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.179624 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.179903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.180299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.181348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.181636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.181919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.182203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.182600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.191870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.192144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.192420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.192696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.193069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.193383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.193670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.195266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.195554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.195840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.196124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.196504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.196796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.197077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.208904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.211782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.212416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.214664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.215348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.216199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.217811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.218089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.218260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.218488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.219741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.221201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.221508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.221905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.225319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.226811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.228909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.229620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.230014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.230305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.230386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.230582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.233286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.233686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.233978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.234259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.238859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.239146 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.239423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.242647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.242944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.243229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.246259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.246823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.247099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.247371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.247641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.247912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.248197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.248473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.248739 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.249019 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.249294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.249558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.249836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.250101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:24:17.250386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.250670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.250947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.251222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.251494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.251769 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.252057 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.252329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.252605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.252885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.253157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.253446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.253783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:24:17.283515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac490279c0 pid: 81493 (default app) Sep 30 09:24:17.287269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f785-07cd-452e-b5db-0c7478328652 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:17.287554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f785-07cd-452e-b5db-0c7478328652 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:17.287824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f785-07cd-452e-b5db-0c7478328652 None None] PATH_INFO: `/v3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:17.288207 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac490279c0 pid: 81494 (default app) Sep 30 09:24:17.291960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Fri Sep 30 09:24:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:24.049176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:24.049728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:24.049728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:24.054533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:24.059953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:24.060523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:24.060523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:24.130435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: INFO dbcounter [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] Registered counter for database keystone Sep 30 09:24:24.149171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG oslo_db.sqlalchemy.engines [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:24:24.155273 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writer thread running {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:24:24.331066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG passlib.handlers.bcrypt [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81493) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:24:24.331919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG passlib.handlers.bcrypt [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81493) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:24:24.388913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:24.390540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:24.516054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 30 09:24:25.083507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:25.153471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: INFO dbcounter [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] Registered counter for database keystone Sep 30 09:24:25.174170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG oslo_db.sqlalchemy.engines [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:24:25.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writer thread running {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:24:25.297734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275338-2a4a-4382-9cee-0daaed7c3c4e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:25.302450 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:25.303070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:25.303350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:25.303623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:25.311582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:25.363792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:24:25.364082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87996dd-740e-46df-b364-67cf17d81f03 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:25.373099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Sep 30 09:24:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:24:25.379633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:25.396154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83ce26-45aa-4759-a4c4-7799cd5f89a2 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:25.400469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:25.401586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:25.401859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:25.402127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] PATH_INFO: `/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:25.403712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] RBAC: Authorizing `identity:get_project(project_id=fb557875fa6e42b4902cd1a1d7e26a4b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:25.456609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING keystone.common.rbac_enforcer.enforcer [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:24:25.456961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93de8c-4bda-430f-afb8-4f9ae2abf7ea admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:25.461525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Fri Sep 30 09:24:25 2022] GET /identity/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:27.556632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fea7e-1212-4539-bd1f-3841a64daf14 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:27.557131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fea7e-1212-4539-bd1f-3841a64daf14 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:27.557213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fea7e-1212-4539-bd1f-3841a64daf14 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:27.561341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:27.567216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:27.567621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:27.567766 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:27.587165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:27.588657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:27.596240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 09:24:27.863110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fea7e-1212-4539-bd1f-3841a64daf14 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:27.875926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fea7e-1212-4539-bd1f-3841a64daf14 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:27.880098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:27.880684 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:27.880961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:27.881235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:27.889007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:27.890798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2decf-3d8e-45e8-ad6c-63b394bfaf91 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:27.899565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Sep 30 09:24:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:24:27.904954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:27.914368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3bf5f-a8be-41df-8b14-579f8b03f64b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:27.918566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:27.919176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:27.919452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:27.919724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:27.921014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:27.922856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3c65-819f-4de6-8e94-83ca582497af admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:27.924352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Fri Sep 30 09:24:27 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:30.119763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55777-8b8e-4166-a155-9f8a940c6c7f None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.120305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55777-8b8e-4166-a155-9f8a940c6c7f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.120305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b55777-8b8e-4166-a155-9f8a940c6c7f None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.121791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:30.127069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.127500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.127750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.132457 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159615d-006b-4998-9319-879c388312b9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.132754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159615d-006b-4998-9319-879c388312b9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.133005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159615d-006b-4998-9319-879c388312b9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.134421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:30.139309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.139594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.139868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.147032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:30.148205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:30.181385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG passlib.handlers.bcrypt [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81494) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:24:30.181778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG passlib.handlers.bcrypt [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81494) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:24:30.228545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:30.231273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:30.232855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:30.332382 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:30.493064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.518064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.594355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e41f5-66d9-4919-8521-b615c9eaaab9 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.598541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.627337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.628549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.628830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.629106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.640142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:30.648900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:30.650024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:30.654431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:30.655833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.703836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27929fe3-4a2f-4811-b322-8fe4ffe2421c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.706312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.736098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.740744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.741651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.741932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.742201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.754517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986a26c-92d7-4055-88f4-48f16823adbf None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.787471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.788064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.788342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.788931 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.789313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:30.789709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.791037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.802462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:30.807957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.810500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.812784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.905870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280177-f7b0-4208-ad58-3f3a129b12bb None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.910974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:24:30.916501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.919081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.939622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.940245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.941018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.941309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.942440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.943887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.945446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:30.950816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.965376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:31.015580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf493b7b-fadc-4efe-add0-835591cb2ad7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:31.047530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d5d6-c7eb-4dba-a7a2-3e907c2d4030 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:31.048873 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:31.049818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:31.050098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:31.050418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:31.068839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:31.070328 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:31.080342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:31.081535 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:31.081836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:31.082106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:31.083209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:31.084642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:31.086200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:24:31.088713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:31.089747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:24:31.090559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:24:31.090559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:31.090559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:31.090559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:24:31.091935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:31.095595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:31.151221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:31.171769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:31.192568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd055-3e8b-47c8-876d-a8e5c3766ab6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:31.196488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360b53-c077-4bc9-ba3f-4d9723ee6a6a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:31.226378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:31.226915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:31.227192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:31.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:31.228224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.domain.id=default, user.id=747baf23ba054f8aad78324c55ee7740) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:31.228326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:31.228528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:31.228849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:31.229125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:31.229424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:31.229989 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72dac1-2157-4ddc-b6cb-5fae1d114ce5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:31.230096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:31.230347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:31.231699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c71b-d38e-4a00-8932-1f75b17ebf7b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:31.236388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Fri Sep 30 09:24:31 2022] GET /identity/v3/role_assignments?user.id=747baf23ba054f8aad78324c55ee7740&scope.domain.id=default&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:31.250290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:33.545175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cfb1-b111-4d79-9bf5-1244e068cee0 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.545175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cfb1-b111-4d79-9bf5-1244e068cee0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.545175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cfb1-b111-4d79-9bf5-1244e068cee0 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.546261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:33.551880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425ef1-a416-4957-8d30-05fa911ff437 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.552700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425ef1-a416-4957-8d30-05fa911ff437 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.553305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425ef1-a416-4957-8d30-05fa911ff437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.578060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-35425ef1-a416-4957-8d30-05fa911ff437 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:33.579599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-35425ef1-a416-4957-8d30-05fa911ff437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:33.674764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:33.778192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7cda6-86c4-41f8-8c51-7bfbfe1aec35 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.778845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7cda6-86c4-41f8-8c51-7bfbfe1aec35 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.779366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7cda6-86c4-41f8-8c51-7bfbfe1aec35 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.780891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:33.786470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00087e-e48e-47c0-b945-e55445f465e6 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.786997 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00087e-e48e-47c0-b945-e55445f465e6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.787493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00087e-e48e-47c0-b945-e55445f465e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.810223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-3a00087e-e48e-47c0-b945-e55445f465e6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:33.811714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-3a00087e-e48e-47c0-b945-e55445f465e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:33.871378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:33.910371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:34.117127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7cda6-86c4-41f8-8c51-7bfbfe1aec35 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.252269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7cda6-86c4-41f8-8c51-7bfbfe1aec35 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:34.257573 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9679-4d0b-4521-bd1d-a5ea48ab6447 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.257861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9679-4d0b-4521-bd1d-a5ea48ab6447 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.258139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9679-4d0b-4521-bd1d-a5ea48ab6447 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.259650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:34.265154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.265477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.265761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.302862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:34.303505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.303787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.304064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.306225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:34.307437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:34.326081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:34.331569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:34.332377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:34.333139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 14/27] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:34.340422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.346461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:34.439525 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:34.441010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.487710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee5dc-ffae-4181-b8d0-b1433f699310 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:34.532784 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:34.533423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.533705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.534507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.535195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:34.535497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:34.536928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:34.561799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:34.570178 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.621410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf3463-2aff-49b7-b5b8-92ba6a52294c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:34.645680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:34.700229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:34.700385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:34.700989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.701296 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.701562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.721886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:34.723368 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-92dca046-96dc-4fb1-9fb9-d76f5a204d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:24:34.748068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:34.748919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:24:34.749731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:24:34.749731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:34.749731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:34.749731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:34.756004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643962c3-c767-4b81-832f-6edb531000d4 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.756287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643962c3-c767-4b81-832f-6edb531000d4 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.756568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643962c3-c767-4b81-832f-6edb531000d4 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.758858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 16/31] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:34.762572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643962c3-c767-4b81-832f-6edb531000d4 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.767142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf2aad-6a13-4d90-916a-c8196a1cca18 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:34.815609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:34.816579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.817047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.817619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.819043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:34.820876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eb621-4492-496a-8961-f60f30d8db7b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:34.822685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 16/32] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:34.823986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.824471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.824880 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.843004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:34.844377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:34.888642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643962c3-c767-4b81-832f-6edb531000d4 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:34.923465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:34.926097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.931484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:34.932227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:34.932584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:34.932931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:34.933709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:34.934075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:34.935522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:34.950608 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 17/34] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:34.951539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:34.983803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:35.027900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:35.095066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de5267-1fe6-4f0d-9e91-1cae9fca4d00 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:35.135715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae167-fa89-4ada-b58e-8b2f920ccf1b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:35.161292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:35.161913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.162190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.162460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.163133 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:35.165398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:35.205183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:35.206350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.206638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.206911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.211190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:35.212680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:35.218620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 18/35] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:35.219586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:35.325627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:35.333462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 18/36] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 30 09:24:34 2022] POST /identity/v3/roles => generated 225 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:35.334428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:35.343671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19aae-4390-4752-8e2d-679449cd41d8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:35.400854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:35.401523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.401804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.402081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.402773 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:35.405070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:35.552084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77be2b-d7d1-43a7-adf7-b5ef44d0eb8d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:35.578829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:35.598489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:24:35 2022] POST /identity/v3/projects => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:35.598663 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:35.598772 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:35.598854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.598854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.599046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] PATH_INFO: `/v3/domains/default/users/747baf23ba054f8aad78324c55ee7740/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.602586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=747baf23ba054f8aad78324c55ee7740, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:35.605289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646cbf1-6409-468d-8bad-64b267230736 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:35.630912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 19/38] 10.222.0.25 () {58 vars in 1361 bytes} [Fri Sep 30 09:24:35 2022] PUT /identity/v3/domains/default/users/747baf23ba054f8aad78324c55ee7740/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:35.632414 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed1a38-e371-4124-818c-14b4d7364ebe None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.632711 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed1a38-e371-4124-818c-14b4d7364ebe None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.633043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed1a38-e371-4124-818c-14b4d7364ebe None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.634826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 20/39] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:35.641672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.641987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.642285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.775934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:35.777458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195cf9-1ff6-4004-a648-47f52744592c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:35.777900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:35.836238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:35.837295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.837599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.837881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.838589 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:35.841340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffbd22-44df-4f3c-b27b-b8c90e6863e0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:35.856423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:35.864790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 30 09:24:35 2022] POST /identity/v3/roles => generated 219 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:35.868385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af68b-3228-4146-a824-27b3d300166e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.868385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af68b-3228-4146-a824-27b3d300166e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.868385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af68b-3228-4146-a824-27b3d300166e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.869334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 21/41] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:35.874475 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.874764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.875069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.875641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:35.896943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:35.898797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:35.985183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 22/43] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:36.155036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:36.256766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:36.259098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeba2f9-ecf9-4ec9-a830-1f0559e43fef None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:36.274319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:36.297564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:36.298176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:36.298457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:36.298732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:36.299949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:36.301371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:36.316787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 30 09:24:36 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:36.374792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079967-87d9-4eca-b742-fe40f0597479 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:36.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:36.422647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:36.423300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:36.423765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:36.424046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:36.425319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:36.426802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8a995-00cd-4bbb-86bd-de2fc2262335 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:36.428621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 23/45] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:36.434269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:36.543727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05ed0-7f14-444a-a195-d14d4c603476 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:36.577621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:36.578212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:36.578486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:36.578760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:36.579397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:36.581395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22b4d-e1e9-4501-a15d-0c3e3dc4f8ef None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:36.611398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:24:36 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:37.875927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e3b6c-959f-44ba-b50d-c506e2f2994e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:37.876438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e3b6c-959f-44ba-b50d-c506e2f2994e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:37.876544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e3b6c-959f-44ba-b50d-c506e2f2994e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:37.877922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:37.883308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:37.883700 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:37.883865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:37.902959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:37.904118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:37.924347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:37.974694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:38.241618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e3b6c-959f-44ba-b50d-c506e2f2994e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:38.348082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e3b6c-959f-44ba-b50d-c506e2f2994e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:38.381664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:38.382293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.382577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.382854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.394702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:38.400994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:38.401949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:38.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:38.409190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:38.504583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a97ec-49b2-4073-abfe-cf811fbeb30d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:38.537233 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:38.537859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.538139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.538412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.539074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:38.539374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:38.540751 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:38.548465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 25/50] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:38.554226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:38.608414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:38.652914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a8b9e-4c08-4c56-941d-f3d4715728c3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:38.687429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:38.688050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.688327 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.688598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.690047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:38.691495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea203745-c4ad-4006-8eea-2d396dd27908 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:38.693063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 26/51] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:38 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:38.698476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:38.717720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:38.762570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc1e71-2fa1-4f34-8629-2b3c90a38657 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.762775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc1e71-2fa1-4f34-8629-2b3c90a38657 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.763305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc1e71-2fa1-4f34-8629-2b3c90a38657 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.764757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 27/52] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:38.769478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.769758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.770031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.787642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:38.788819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:38.798176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe8f2e-93ed-4d47-b7ef-2a41595821b8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:38.830895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:38.831512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.831789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.832059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.833157 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:38.834607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:38.836319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:38.841726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:38.855546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:38.923417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:38.937705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98008ed-c07e-4634-861c-8b6dc62fd9dd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:38.970048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:38.970640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.970917 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.971213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.971927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.domain.id=default, user.id=747baf23ba054f8aad78324c55ee7740) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:38.972230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:38.973696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:38.979248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1322 bytes} [Fri Sep 30 09:24:38 2022] GET /identity/v3/role_assignments?user.id=747baf23ba054f8aad78324c55ee7740&scope.domain.id=default&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:39.123948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:39.180667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:39.224917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d74518-b67f-492d-a065-e07656eab7f3 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:39.359050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:39.359656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:39.359932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:39.360205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:39.361307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:39.363731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec526f-2865-4475-ba71-56314342e8ed None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:39.364780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 29/56] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:39.370376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:39.466903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd821-a309-49e1-9773-48ae5982fc85 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:39.498907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:39.499498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:39.499778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:39.500052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:39.500693 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:39.502165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c687e-79e5-4c38-a48c-04709f55e616 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:39.527965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1140 bytes} [Fri Sep 30 09:24:39 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:41.661051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216b2b-cb54-49af-b9d6-ee1c95ac4dc1 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:41.661564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216b2b-cb54-49af-b9d6-ee1c95ac4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:41.661564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216b2b-cb54-49af-b9d6-ee1c95ac4dc1 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:41.662861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:41.667934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:41.668312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:41.668489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:41.679366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:41.693613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:41.694786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:41.758383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:42.029004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216b2b-cb54-49af-b9d6-ee1c95ac4dc1 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:42.125623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216b2b-cb54-49af-b9d6-ee1c95ac4dc1 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:42.147695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:42.158812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:42.159413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:42.159690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:42.159958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:42.161048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:42.162497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdaab6-5aa2-494e-b2d6-8749d84224e3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:42.164013 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:42.169511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:42.263438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bab2e-0ea2-43c3-8c4a-12f880e6f5bd None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:42.291560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:42.296456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:42.297050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:42.297360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:42.297641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:42.298295 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:42.299749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7ffe-9812-4a09-a4bc-661f8a8789d0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:42.324581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:42 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:24:45.383952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b566d9-4ab9-4154-8b77-26324a8cc098 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.384951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b566d9-4ab9-4154-8b77-26324a8cc098 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.385480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b566d9-4ab9-4154-8b77-26324a8cc098 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.387077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:45.392975 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68daa0-b271-48b1-b7f4-c668cd593bbb None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.393825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68daa0-b271-48b1-b7f4-c668cd593bbb None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.394312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68daa0-b271-48b1-b7f4-c668cd593bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.422302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1c68daa0-b271-48b1-b7f4-c668cd593bbb None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:45.423491 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1c68daa0-b271-48b1-b7f4-c668cd593bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:45.511800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:45.770521 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36dd9-53ba-417c-a620-df177d8772d6 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.771006 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36dd9-53ba-417c-a620-df177d8772d6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.771415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f36dd9-53ba-417c-a620-df177d8772d6 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.773165 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:45.778153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ff3a-52b0-47e8-80ba-4acfe978b3f8 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.778599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ff3a-52b0-47e8-80ba-4acfe978b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.779011 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ff3a-52b0-47e8-80ba-4acfe978b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.802250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-0c01ff3a-52b0-47e8-80ba-4acfe978b3f8 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:45.803442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0c01ff3a-52b0-47e8-80ba-4acfe978b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:45.883665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:45.885977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adfe2d-0dda-49a8-9c7f-ae35b01add37 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.886465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adfe2d-0dda-49a8-9c7f-ae35b01add37 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.886930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adfe2d-0dda-49a8-9c7f-ae35b01add37 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.888729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 34/66] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:45.894556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ebc4-87b6-46e7-bdc7-89b6645e1155 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.894847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ebc4-87b6-46e7-bdc7-89b6645e1155 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.895125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ebc4-87b6-46e7-bdc7-89b6645e1155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.908734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adfe2d-0dda-49a8-9c7f-ae35b01add37 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.918112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4136ebc4-87b6-46e7-bdc7-89b6645e1155 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:45.919323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4136ebc4-87b6-46e7-bdc7-89b6645e1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:45.977708 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.019443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:46.071402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adfe2d-0dda-49a8-9c7f-ae35b01add37 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.121938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.122664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.122947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.123221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.143350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:46.148199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:46.149021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:46.149814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:46.151906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675d8-193a-432e-8e6b-2d38c0466b5a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.152437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675d8-193a-432e-8e6b-2d38c0466b5a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.152911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675d8-193a-432e-8e6b-2d38c0466b5a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.155319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 34/69] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:46.158662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.160294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.160581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.160862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.189970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:46.191172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:46.235617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.289279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:46.290414 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.308517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0d9a0-f219-4fa7-89e1-53b2089673b8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.356192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.357051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.357515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.357934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.358744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:46.359192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:46.360747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:46.373847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:46.380794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.467578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599051a-d7ce-479f-82be-7b767e766eb0 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.477946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.505179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.505930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.506211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.506485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.513204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b2a84-0b2a-4a44-99a4-b58fdc1cb4b8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.517581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:46.522641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:46.523688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 36/72] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:46.524623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.531210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.555678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.556309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.556593 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.556874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.573185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:46.574659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:46.580732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:46.580732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.630237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc440c-c446-4175-8315-c177742e7e51 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.663239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.663861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.664140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.664411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.675069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-c0502d7c-2959-4d2c-82ad-69a6e704a996 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:46.679860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:46.680689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:46.681477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:46.682047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a5a7-9f4e-422c-a718-806672771b9d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.682123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:46.682123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cae52-a9a7-4a1f-bb4c-f70c5ead0148 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.682964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cae52-a9a7-4a1f-bb4c-f70c5ead0148 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.682964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cae52-a9a7-4a1f-bb4c-f70c5ead0148 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.684510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 38/75] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:46.685059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cae52-a9a7-4a1f-bb4c-f70c5ead0148 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.715155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.715434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.716073 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.716421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.716792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.717604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:46.717915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:46.719300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:46.728082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 38/76] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:46.728870 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:46.760485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.790921 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cae52-a9a7-4a1f-bb4c-f70c5ead0148 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.823298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.823907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.824184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.824455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.828179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40883-6a8d-4c47-ae89-833e3716f045 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:46.861129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:46.862261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.862541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.862813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.872808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-bf028cfd-6cad-4825-94af-35b6de588c8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:46.878694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:46.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:46.880534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 39/77] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:46.881190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:46.881190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:46.881523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:46.895782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:46.897272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:46.898475 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:46.899655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:46.923074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:46.964155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 40/78] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:46.965000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.000139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 39/79] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:47.000139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.000683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.082923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db977c8-7341-48a0-9db4-0b8379673f75 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.096954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153c57c-cf0a-49d8-93fb-8e4786b0c82a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.121539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.122371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.122795 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.123319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.123962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.124942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:47.125273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.126657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.133154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.133764 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.134051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.134327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.135459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.136200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.136905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.137249 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.138909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 40/81] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:46 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.139500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.236554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.242427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdcb0e-4d55-4adf-af47-10ca47fcc11b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.253852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2259b-e43d-4e5f-8f0a-828639535eec None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.276649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.277374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.277658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.277934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.279081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.280555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.285312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 41/82] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.285312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.290091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.290691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.290968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.291238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.291901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:47.292201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.293673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.303254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 42/83] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.304038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.348256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.385029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adb4a7-541f-4e8e-ad5c-220d8f9b7722 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.404298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bdc0-4557-4bcb-83b8-6a70ddbae7ec None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.421814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.422439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.422718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.422992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.424142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.425625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.427185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 42/84] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.430059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.437886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.438492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.438776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.439054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.454741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.506601 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.508062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.527877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9519-2b9f-457d-8747-633c1dfb589c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.555613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.560517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.561147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.561452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.561728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.562832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.564814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.566400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 43/85] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.567153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.609295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 43/86] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:47.610012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.661975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.665522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369bb4f-4950-4db2-ac1b-5620111d6661 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.698489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.699088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.699373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.699652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.700384 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:47.700690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.702171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.707321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 44/87] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=509124be46144611a84fe7272045de87 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.708086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.715013 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137eff7-94f9-4328-ba1d-61005cdc62b0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.757028 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.758015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.758015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.758233 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.759458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.760953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.762926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:47.763722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.808526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.857445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923eff5-cf1a-4c19-b514-7bbfa89fa5eb None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.870528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ec9ca-124b-40a3-bb30-3e4a0a9ec68b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:47.885609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:47.896406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.897016 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.897316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.897651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.911579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:47.912241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:47.912521 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:47.912803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:47.913667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.915536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:47.947728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 45/89] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:47 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:47.947728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:47.988504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:47.990286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.062730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.086454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65150eff-7d5a-425c-9a0b-6e196a0bb331 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.117503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:48.118729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.142288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.143007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.143341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.143626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.144843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.147001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.148743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:47 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.154219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.208609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.254323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9cea8-e542-4721-b611-e8d321f9e112 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.286712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3f56-c665-48b2-848b-b0e4240f340e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.300511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.301126 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.301447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.301725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.332862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.333529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.333819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.334099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.335265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.336782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.338644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 47/92] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.339277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.341560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.395815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.397394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.486782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f767d-dd60-4d41-9ea0-17545942fed2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.495187 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.522941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:48.524606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.529813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.530597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.530951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.531298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.532211 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=747baf23ba054f8aad78324c55ee7740) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:48.532592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.534302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.544076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 48/94] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/role_assignments?user.id=747baf23ba054f8aad78324c55ee7740&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.551288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.664153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.742626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9edbd-bfb7-4cf5-a47f-aa789fd78c8f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.798824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.799815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.800299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.800767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.802096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:48.802616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.804479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.816270 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef648-1561-4308-93ef-b8d3f0c47d32 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.819364 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 47/95] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=4203118e6def4ea283ce4c49694a4892 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.881656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f031a8-0ced-4100-860a-16302822939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.882308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f031a8-0ced-4100-860a-16302822939c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.882597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f031a8-0ced-4100-860a-16302822939c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.882914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f031a8-0ced-4100-860a-16302822939c None admin] PATH_INFO: `/v3/projects/1805e30475a34b6d97c7b030789046ca` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.884085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f031a8-0ced-4100-860a-16302822939c None admin] RBAC: Authorizing `identity:get_project(project_id=1805e30475a34b6d97c7b030789046ca)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.885580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f031a8-0ced-4100-860a-16302822939c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.887231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 49/96] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/projects/1805e30475a34b6d97c7b030789046ca => generated 312 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.893914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:49.032285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a23e-2077-4b2a-b0c1-406321754129 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:49.060433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:49.070167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:49.071088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:49.071567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:49.072037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:49.072963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=1805e30475a34b6d97c7b030789046ca, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:49.073545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:49.075190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bd6ff-f6ef-46d1-893d-23a6e39075e3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:49.085716 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=1805e30475a34b6d97c7b030789046ca&role.id=509124be46144611a84fe7272045de87 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:50.854479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762b9-cac7-4439-aad1-027f06250d7d None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:50.854993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762b9-cac7-4439-aad1-027f06250d7d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:50.855065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762b9-cac7-4439-aad1-027f06250d7d None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:50.856517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 50/98] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:50.862872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca928-9e01-406d-bd9f-db3c68d1d81e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:50.863345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca928-9e01-406d-bd9f-db3c68d1d81e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:50.863445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca928-9e01-406d-bd9f-db3c68d1d81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:50.881958 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-377ca928-9e01-406d-bd9f-db3c68d1d81e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:50.883153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-377ca928-9e01-406d-bd9f-db3c68d1d81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:50.978620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 49/99] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:51.132033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd653d29-8205-4eb0-b060-0a5ed46534d7 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd653d29-8205-4eb0-b060-0a5ed46534d7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd653d29-8205-4eb0-b060-0a5ed46534d7 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.134668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 51/100] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:51.140269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcad0-88f9-405e-ac24-c52324be95ce None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.140560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcad0-88f9-405e-ac24-c52324be95ce None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.140838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcad0-88f9-405e-ac24-c52324be95ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.170261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-fb2fcad0-88f9-405e-ac24-c52324be95ce None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:51.171456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fb2fcad0-88f9-405e-ac24-c52324be95ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:51.249451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:51.412726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd653d29-8205-4eb0-b060-0a5ed46534d7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:51.480561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:51.565688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd653d29-8205-4eb0-b060-0a5ed46534d7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:51.598804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d195b-3fb3-4fa0-87f9-83145740ee24 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.599409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d195b-3fb3-4fa0-87f9-83145740ee24 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.599926 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d195b-3fb3-4fa0-87f9-83145740ee24 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.601634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 51/102] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:51.607539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.608105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.608613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.615692 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:51.616326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.616606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.616883 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.630784 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:51.632408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:51.636905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:51.642268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:51.643203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:51.644097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 52/103] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:51.649652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:51.721727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:51.758593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:51.759374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:51.832342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:51.836353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7e1e-b320-4c19-87d9-4131aa1cf7a6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:51.876771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:51.877562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.877943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.878319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.879090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:51.879493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:51.880969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70b50d-f9bd-440a-b4f9-2dbaba0fd92b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:51.889635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 53/105] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:51.890895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02380d9-661c-453e-a6ce-1e752fac3e26 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.891280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02380d9-661c-453e-a6ce-1e752fac3e26 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.891674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02380d9-661c-453e-a6ce-1e752fac3e26 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.893155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 54/106] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:51.894138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e786-9b8a-406a-bb5a-c61974b6a59f None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.894513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e786-9b8a-406a-bb5a-c61974b6a59f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.894888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e786-9b8a-406a-bb5a-c61974b6a59f None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.896170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 55/107] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:51.898549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07e786-9b8a-406a-bb5a-c61974b6a59f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:51.932930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe7278-77a1-4a4a-b6ec-0020fe645109 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:51.980021 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:51.981040 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.981352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.981630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.995732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-46723e8f-5a53-46c0-9188-eb72e32cfa54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:52.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:52.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 53/108] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:52.007475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.009062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.009062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.009309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07e786-9b8a-406a-bb5a-c61974b6a59f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.027584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:52.028884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:52.065911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.066793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.067101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.068147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.069554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.071444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.073035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6432-c2f8-440a-a954-a877c00bea30 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.075926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 56/109] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.078463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.079261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.080260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.104249 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:52.105594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:52.106782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:52.107625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.131432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.188295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:52.190216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.241700 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644359a-047a-47d3-bf87-bf2b5e50400c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.288579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.289703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.290055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.290446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.291457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:52.291830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.293577 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.309277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 55/112] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.309277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.320778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4a272-ebc5-45fa-a95b-4926480d32b5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.361691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.366665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.367526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.367936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.368425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.370459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.372571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.378297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 58/113] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.378297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.417694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.460440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde9df-481a-477b-aa18-cc1eb15ebef3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.499222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f960121-199c-49ce-8a6f-1f8a6ab993c1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.505046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.505731 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.506009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.506281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.507397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.508843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.510428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 56/114] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.511454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.552607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.555035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.555730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.556243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] PATH_INFO: `/v3/users/49a8ee03bd924981a929c37387456293` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.574077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] RBAC: Authorizing `identity:get_user(user_id=49a8ee03bd924981a929c37387456293)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.575789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.577524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 59/115] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/users/49a8ee03bd924981a929c37387456293 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.582816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.622930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c03c6-20bf-4837-99c1-b91ea11c5b0c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.624568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.659987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.660646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.660929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.661206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/722876754eac470fb2750ddfe010bf80/roles/509124be46144611a84fe7272045de87` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.663138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, user_id=722876754eac470fb2750ddfe010bf80, role_id=509124be46144611a84fe7272045de87)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.664570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.668252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.677083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 57/116] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:52 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/722876754eac470fb2750ddfe010bf80/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:52.677887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.685964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffd22-3b69-497e-a7a8-191d5bcb4a41 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.727970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.728621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.728907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.729182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.742697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:52.748237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:52.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:52.750020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 60/117] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:52.750671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.790018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec0d1-5fbb-4824-8f90-0d46dbb2ecb8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.825263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.825912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.826194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.826470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.827139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.828609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.863740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 58/118] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:24:52 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:52.864509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.868394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26830ac-e33a-4342-96a9-b71ba4189d35 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.881082 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.919716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.920423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.920638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.920913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.933644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-4e42d119-2850-4164-a56b-b01b030136c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:52.939928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:52.940856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:52.941648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:52.946856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f4ab6-195e-4395-9bac-f6da82ffef68 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.947145 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f4ab6-195e-4395-9bac-f6da82ffef68 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.947422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f4ab6-195e-4395-9bac-f6da82ffef68 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.948937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 62/120] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:52.950988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f4ab6-195e-4395-9bac-f6da82ffef68 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.957459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.990328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02be9b-641a-4548-8353-91c0a982320b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.029433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.030419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.030718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.031099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.089676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f4ab6-195e-4395-9bac-f6da82ffef68 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.116461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.118166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b467f-73e1-4c86-ba62-2ae4f0459aff None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.135958 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.136675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.137368 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.137875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.138129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.139124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:53.139124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.140479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.151377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 63/121] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.157043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:53.239097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.240140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.240435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.240863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.260762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:53.262090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:53.275594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532302-4d9e-4540-97fb-0969ac4c1e24 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.315823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.316439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.317246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.317602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.318568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:53.318887 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.320644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.330330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 64/123] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.331160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.331373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:53.332219 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.422153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.492291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb422-a13e-4f8c-b105-6e727a521a6c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.531583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.532448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.532902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.533341 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.534647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.536841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.538959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 61/125] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.539870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.568158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472a6b-7203-4984-a4d2-df5a4ca15be4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.625640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.636109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.636762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.638547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.638829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.640888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.646082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.649707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 65/126] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.723821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a156-d100-4eb7-8d67-6dff897ac8df None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.753731 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.762223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.763116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.763447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.763722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.764308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3316b0-34cf-4c57-afb7-595df1ac01f0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.764861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.766596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.768218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 62/127] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.768982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.803071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:53.803676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:53.803957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:53.804236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:53.804965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=49a8ee03bd924981a929c37387456293) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:53.805476 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:53.807689 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:53.814043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 66/128] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/role_assignments?user.id=49a8ee03bd924981a929c37387456293&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:53.815170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:53.920313 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:53.935431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7cf9-7c7c-406b-af6f-776c661e91ca None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:53.967126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252bae-deb2-4fa9-a1e8-dbee17cbf002 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.005958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.006606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.006891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.007170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.017732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.018388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.018660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.018942 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.019850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:54.020090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:54.025429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:54.027502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 67/129] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:54.029421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.031078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.031078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 63/130] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:53 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:54.042393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.125692 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:54.140147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba782-bf8f-42e9-8786-c235e4b2064a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.162236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:54.180795 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.181385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.181666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.181942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.186220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.187693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.189384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:54 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:54.190152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.271404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185142e-6a0b-45ed-96c9-60753b898d7f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.307985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e81ed-23c3-4cf6-b930-ff7a22587e40 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.340709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.341675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.341960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.342236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/722876754eac470fb2750ddfe010bf80/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.345145 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, user_id=722876754eac470fb2750ddfe010bf80, role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.346660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.364539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.365572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.366079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 64/132] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:54 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/722876754eac470fb2750ddfe010bf80/roles/4203118e6def4ea283ce4c49694a4892 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:54.366247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.366247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.366622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.366850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:54.367275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.368646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.390742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 69/133] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:54.397963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.519235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c83d4-08c5-4a97-9c17-21b0eb8b0e7d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.529649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:54.570155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:54.572031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.572757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.573046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.573352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/747baf23ba054f8aad78324c55ee7740/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.577681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, user_id=747baf23ba054f8aad78324c55ee7740, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.579293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.604338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:54 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/747baf23ba054f8aad78324c55ee7740/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:54.664662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42fe1-98eb-4f30-8bb6-bfe72838c7dd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.715665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.716379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.716670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.716946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.718171 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.719642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.722142 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 70/135] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:54 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:54.727601 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:54.893645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202929-1de1-4da3-91a9-ffe2bb02d1e9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:54.930568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:54.931209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:54.931489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:54.931763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] PATH_INFO: `/v3/projects/1805e30475a34b6d97c7b030789046ca` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:54.934009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] RBAC: Authorizing `identity:get_project(project_id=1805e30475a34b6d97c7b030789046ca)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:54.935679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bb3b-26f1-49b6-a7ff-58c567da6df4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:54.937583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:54 2022] GET /identity/v3/projects/1805e30475a34b6d97c7b030789046ca => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:54.944126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:55.117984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b610-927e-45dd-895b-1207369fa438 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:55.139685 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:55.155665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:55.156371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.156678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.156966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] PATH_INFO: `/v3/projects/1805e30475a34b6d97c7b030789046ca/users/722876754eac470fb2750ddfe010bf80/roles/509124be46144611a84fe7272045de87` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.159616 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] RBAC: Authorizing `identity:create_grant(project_id=1805e30475a34b6d97c7b030789046ca, user_id=722876754eac470fb2750ddfe010bf80, role_id=509124be46144611a84fe7272045de87)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:55.161080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77cd8e-38bd-48e1-b665-e908a7305781 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:55.177871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:54 2022] PUT /identity/v3/projects/1805e30475a34b6d97c7b030789046ca/users/722876754eac470fb2750ddfe010bf80/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:55.323397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ace9-7ec2-44e7-8a3f-6faddc713a66 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.324424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ace9-7ec2-44e7-8a3f-6faddc713a66 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.324929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ace9-7ec2-44e7-8a3f-6faddc713a66 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.326571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 67/138] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:55.333389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.333685 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.333968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.363902 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:55.365181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:55.417842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d721fa-bdbe-4d45-aa05-cd83546a8bbc None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.418179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d721fa-bdbe-4d45-aa05-cd83546a8bbc None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.418404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d721fa-bdbe-4d45-aa05-cd83546a8bbc None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.419903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 68/139] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:55.426595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.426886 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.427177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.450245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 72/140] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:55.471063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:55.472282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:55.519902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:55.574118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 69/141] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:55.779896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:55.887950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c96c6-56c2-4090-8825-998f13e465a0 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:55.898232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:55.925687 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:55.926367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:55.926665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:55.926980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:55.937993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:55.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:55.945112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:55.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 73/142] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:55.951081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:56.081681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753093f-c13e-45ee-b0fa-5571e204e2b6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:56.128763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:56.129410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:56.129689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:56.129964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:56.130646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:56.130951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:56.132329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:56.140378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:56.144678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 70/143] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:56.162917 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:56.209620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:56.318042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c6851-3dd9-4446-a630-68d7d8c5f878 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:56.374725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f7e4-26a8-40e5-9b27-632d26df8751 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:56.377186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:56.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:56.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:56.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:56.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:56.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:56.383217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 74/144] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:56.388830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:56.447652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:56.456902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:56.457561 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:56.457838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:56.458208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:56.459609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:56.461141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:56.462830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:56 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:56.476907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:56.574506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70479cc8-2314-446e-aaef-eee40eec12cf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:56.640021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:56.640547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:56.640825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:56.643396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:56.644068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:56.647030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:56.649063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:56.656798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4d1-6bef-44f2-9a46-027c9488fdc6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:56.689724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 75/146] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:56 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:56.709168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:56.709811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:56.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:56.710359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:56.783433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:56.784933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:56.902039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:56.908854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 72/147] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:24:56.914512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:57.040704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:57.050930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d1aa-4a1f-42c2-b8c9-d43e91369613 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:57.089584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:57.090229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.090513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.090785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.091951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:57.093449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f66480-fecc-480c-958a-bb1751fbef25 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:57.095624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 76/148] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:56 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:57.101830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:57.209635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574869d6-3841-4549-88c7-24be8289ca94 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:57.250888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:57.252032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.252306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.252575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.253323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:57.253631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:57.255196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578af44-3a4b-4dd7-be5d-c2e998e01609 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:57.265923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 73/149] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:57 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=509124be46144611a84fe7272045de87 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:57.516632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bbe5-fa52-4306-bce5-f052f5df61d8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.516989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bbe5-fa52-4306-bce5-f052f5df61d8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.517157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bbe5-fa52-4306-bce5-f052f5df61d8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.518667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 77/150] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:57.524542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965121c-099b-4a36-9e39-ff6e8adcddc3 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.525507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965121c-099b-4a36-9e39-ff6e8adcddc3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.526003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965121c-099b-4a36-9e39-ff6e8adcddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.550296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1965121c-099b-4a36-9e39-ff6e8adcddc3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:57.551806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1965121c-099b-4a36-9e39-ff6e8adcddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:57.618979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:57.634398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 74/151] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:57.772823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64480-6205-476d-a0d5-b717230e0db6 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.773528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64480-6205-476d-a0d5-b717230e0db6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.774011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64480-6205-476d-a0d5-b717230e0db6 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.775549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 78/152] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:57.781055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812084b0-0028-4c15-8921-67c485630313 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:57.781582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812084b0-0028-4c15-8921-67c485630313 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:57.782074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812084b0-0028-4c15-8921-67c485630313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:57.804869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-812084b0-0028-4c15-8921-67c485630313 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:57.806382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-812084b0-0028-4c15-8921-67c485630313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:57.880345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:24:58.054898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6325fe-414e-4f3d-9f8c-b6b91f2ed279 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.056034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6325fe-414e-4f3d-9f8c-b6b91f2ed279 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.056513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6325fe-414e-4f3d-9f8c-b6b91f2ed279 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.058087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 79/154] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:58.063178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64419c-0a06-4c00-b835-b96968e2dc51 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.064245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64419c-0a06-4c00-b835-b96968e2dc51 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.064734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64419c-0a06-4c00-b835-b96968e2dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.068334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812084b0-0028-4c15-8921-67c485630313 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.090385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-7c64419c-0a06-4c00-b835-b96968e2dc51 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:58.091587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7c64419c-0a06-4c00-b835-b96968e2dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:58.178978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 80/155] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:58.181676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223a63f-3366-4c7f-b60d-9939f91f9925 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.181965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223a63f-3366-4c7f-b60d-9939f91f9925 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.182258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223a63f-3366-4c7f-b60d-9939f91f9925 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.183531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 81/156] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:58.206291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.206606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.206858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.212954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812084b0-0028-4c15-8921-67c485630313 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.227363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:58.228827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:58.237090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:58.257032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.258055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.258842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.259355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.273556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:58.280156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:58.281000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:24:58.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:24:58.284765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 76/157] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:58.292752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.328515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 82/158] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:24:58.415456 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.429286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60bb9-c145-4218-a358-dacf62b4ec92 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.442299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:58.466683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.467319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.467595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.467867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.468858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:58.468858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:58.470285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:58.479233 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 77/159] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:58.484722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.541277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:58.550527 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541dcc1-fc6b-4957-afdf-aea32d8d93b9 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.591531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.592254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.592632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.593000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.606374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:58.608083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602dee8-8e58-4b06-8444-cf53ad2f2f93 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:58.612257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:58.613317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:58.614114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 83/160] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:58.619826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.647600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.648549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.649008 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.649487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.650912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:58.652569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:58.654390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 78/161] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:58.660822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.715364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:58.740305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590ac2-ba07-4b9f-945b-bda2996f13c5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.780059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.780931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.781454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.781889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.783667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:58.784141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:58.786240 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:58.795989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 84/162] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:58.797022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:58.825498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3d31-6471-4fce-9e10-768e982a61d5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.846992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:58.917976 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.918452 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02301d-be87-44bd-b4c2-c02433b2236f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:58.918569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.918846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.919114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.967151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:58.967780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:58.968054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:58.968323 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:58.993131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:59.005411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:59.006284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:59.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:59.010227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 85/163] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:59.013715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.018691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:59.066033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.067519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.170465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d16b3-4d81-4b50-b63a-a6314c3d1401 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.216078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.216704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.217061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.217298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] PATH_INFO: `/v3/users/49a8ee03bd924981a929c37387456293` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.218419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] RBAC: Authorizing `identity:get_user(user_id=49a8ee03bd924981a929c37387456293)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.220373 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.222288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 86/164] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/users/49a8ee03bd924981a929c37387456293 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:59.223185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.272128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 79/165] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:24:59.272982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.297922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:59.301099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:59.333696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0505a-b128-49f5-ad49-2a092f61817c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.379449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.380076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.380351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.380619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:59.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:59.411473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:24:59.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 87/166] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:59.412911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.476354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dc5-11ba-4688-bf45-5d911788c606 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.513843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.514447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.514720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.515449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.516115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:59.516413 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.518814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.529016 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 80/167] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:59.529695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.618155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f016-4e15-4922-83bc-4b5468cbcb0c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.660070 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:59.679805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:59.691881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.692525 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.692802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.693078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.695409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.696882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.706991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 88/168] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:59.707816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.717389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a38425-3f4f-4513-a0d6-c1b4ad021c60 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.793967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.794949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.795468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.795942 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.798610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.800187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.801862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 81/169] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:59.807389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:59.854096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c121-0439-45af-9cee-86fcb874cfab None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:59.894107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:59.894710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:59.894982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:59.895251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:59.895919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:59.896214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:59.897602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:59.916666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 89/170] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:59.918401 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:00.005746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90734-32bd-4130-a164-6286300e3a38 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.029098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.073103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.073693 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.073972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.074245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] PATH_INFO: `/v3/users/747baf23ba054f8aad78324c55ee7740` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.075380 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] RBAC: Authorizing `identity:get_user(user_id=747baf23ba054f8aad78324c55ee7740)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.076883 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.078792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 82/171] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:59 2022] GET /identity/v3/users/747baf23ba054f8aad78324c55ee7740 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:00.080111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:00.091369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.119236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b22502-69af-49b8-b7c0-cdfd72a02c48 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.186362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.192800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.193485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.194005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/49a8ee03bd924981a929c37387456293/roles/c0b43d11d58e4726ae8bd6e73eb7154b` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.196340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, user_id=49a8ee03bd924981a929c37387456293, role_id=c0b43d11d58e4726ae8bd6e73eb7154b)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.198218 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.220714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 90/172] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:59 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/users/49a8ee03bd924981a929c37387456293/roles/c0b43d11d58e4726ae8bd6e73eb7154b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:00.221832 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:00.226944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd607f8-c475-4bc4-a3dd-520f9387a815 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.271657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.272419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.272763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.273109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.273953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:00.274885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.276534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.290277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 83/173] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:00 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=4203118e6def4ea283ce4c49694a4892 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:00.291895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:00.447832 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365f3c-b95e-4509-b78b-cd08e7ea1950 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.461708 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.482630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.514984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.515668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.515954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.516231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] PATH_INFO: `/v3/users/722876754eac470fb2750ddfe010bf80` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.516588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4a959-08b4-4154-b450-74c7ac55461a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.518084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=722876754eac470fb2750ddfe010bf80)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.519700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e99e88-fe35-4dcb-99a5-292277aa4ca4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.521640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 91/174] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:00 2022] GET /identity/v3/users/722876754eac470fb2750ddfe010bf80 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:00.522984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4247-59a5-4f33-8bb2-061c4a845106 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.523266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4247-59a5-4f33-8bb2-061c4a845106 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.523534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4247-59a5-4f33-8bb2-061c4a845106 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.524808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 92/175] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:00.530255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4247-59a5-4f33-8bb2-061c4a845106 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:00.584778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.585426 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.585702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.585967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.686802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4247-59a5-4f33-8bb2-061c4a845106 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:00.698111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.700479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639f55b-1779-4152-b4be-46d930121555 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.737153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:00.737924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.738202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.738476 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.810648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.841411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:00.863914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 84/176] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:00.864978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:00.865276 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:00.865548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:00.870878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:00.872349 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:00.903516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:00.904744 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:01.002504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 93/177] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:01.003320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.005246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 85/178] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:01.027119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.107421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.120876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d1a7-fc5b-44f5-a9bb-203bf66d18cd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.159982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.160621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.160901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.161283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.168716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8d486-7e43-4aba-81aa-dd5ad66b3a90 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:01.171861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 94/179] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:01.173554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ab43-aed2-4507-813b-9066635206df None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.173829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ab43-aed2-4507-813b-9066635206df None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.174099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ab43-aed2-4507-813b-9066635206df None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.175429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 95/180] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:01.185297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19240672-89da-4a0f-b610-e197e29f1916 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.185578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19240672-89da-4a0f-b610-e197e29f1916 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.188128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19240672-89da-4a0f-b610-e197e29f1916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.211647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-19240672-89da-4a0f-b610-e197e29f1916 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:01.212403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998ce21-46af-4dc3-a555-02abb736621b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.213410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-19240672-89da-4a0f-b610-e197e29f1916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:01.214062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.251990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.252721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.252943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.253212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] PATH_INFO: `/v3/projects/1805e30475a34b6d97c7b030789046ca` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.254452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] RBAC: Authorizing `identity:get_project(project_id=1805e30475a34b6d97c7b030789046ca)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:01.255953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:01.257895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 86/181] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/projects/1805e30475a34b6d97c7b030789046ca => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:01.258464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.303253 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 96/182] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:01.309939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f89e-b98e-4d13-8d85-6159a1698658 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.310221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f89e-b98e-4d13-8d85-6159a1698658 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.310490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f89e-b98e-4d13-8d85-6159a1698658 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.312654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 97/183] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:01.318954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f89e-b98e-4d13-8d85-6159a1698658 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.394929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263257-4339-47fb-a806-a69844aaee8d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.438042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.446740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.448530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.448961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.450513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=747baf23ba054f8aad78324c55ee7740) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:01.450977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:01.453599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eb9f7-7c2e-4fd8-b3bf-3f2b16bd91f4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:01.456431 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f89e-b98e-4d13-8d85-6159a1698658 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.461903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 87/184] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/role_assignments?user.id=747baf23ba054f8aad78324c55ee7740&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:01.463398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.463837 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.464818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.490211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:01.491809 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:01.493370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.494046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.494391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.494725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.495614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=1805e30475a34b6d97c7b030789046ca, user.id=722876754eac470fb2750ddfe010bf80) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:01.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:01.497540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:01.507966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 98/185] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/role_assignments?user.id=722876754eac470fb2750ddfe010bf80&scope.project.id=1805e30475a34b6d97c7b030789046ca&role.id=509124be46144611a84fe7272045de87 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:01.509373 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.526266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.580475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 88/186] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:01.642686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fa70-b65f-4715-b6ba-62de32dce906 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.682302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.683209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.683642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.684050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.697880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:01.703729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:01.704767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:01.705602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:01.707686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 99/187] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:01.714232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.797629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.811391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.833374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550f9f-7f23-4939-80a8-38f83e2819c1 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.868919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.869548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.869822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.870092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.870750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:01.871045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:01.872412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:01.880904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 89/188] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:01.887094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.913743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9eb68-2c72-4f22-a94f-a8169cd619f2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:01.917958 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:01.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:01.952389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:01.952857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:01.953388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:01.965050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:01.970943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:01.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:01.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:01.974865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 100/189] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:01.980678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:01.995423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0082ec6-f4c6-4c58-9a7a-6bf3c3c43401 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.042246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.043085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.043463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.043866 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.061359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.063201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.066261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 90/190] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.067215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.081745 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.119618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515fc5-3716-4c3c-a0ae-c3dd89e9df77 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.156943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.157601 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.157875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.158143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.158806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:02.159102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.160474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.172742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 101/191] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.172742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.175442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.192591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e0425-d082-4822-b9b7-55fdf8cd0431 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.233269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.234194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.234901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.235180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.236504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.238116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.244141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 91/192] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.244141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.281121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e43df-901c-459d-8d26-35b8edd4204d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.312522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.319247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.320147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.320611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.320891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.341186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac8d8-5e0f-419c-9acb-bca83c529de2 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.373991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.374612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.374888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.375166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.376777 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.378243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.384128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 92/193] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.384128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.397459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.398915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.408571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.494472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aef54-0f96-4d4e-b4f1-c0a505df2265 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.502988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 102/194] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:02.507930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.535881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.536691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.537233 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.537571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.537992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.538642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.540746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.561469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 93/195] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:02 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:02.562185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.645177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cad3b-d861-47e1-bdf8-4739daa20005 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.652196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.680921 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e476f-426e-4f9c-a876-216674002a2b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.699848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.701274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.701762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.702294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.720904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.721581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.721851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.722121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.723935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.725530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.732170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 94/196] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.733521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.796266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.799949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153fee7-e70a-44c2-8bb8-7f5aa250f35a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.846377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.854772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84486b-9b72-44a3-80e6-c59ad361d4ce None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:02.891043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:02.892164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:02.892438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:02.892717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:02.893585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=4aaf807ff32642e8ad2e6e4384b0d8a4) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:02.893980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:02.895478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:02.901148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 95/197] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/role_assignments?user.id=4aaf807ff32642e8ad2e6e4384b0d8a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.933297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 103/198] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:02.939655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:02.952304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:03.069938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6132-4002-4235-a9ee-f93080afdfbe None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:03.112650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:03.113600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.114016 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.114424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.115846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:03.118600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738b64-dcca-443b-988d-114979379148 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.118874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738b64-dcca-443b-988d-114979379148 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.119143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66738b64-dcca-443b-988d-114979379148 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.119896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678ce05-bcb1-41b1-98e8-ad13e958b47f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:03.120729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 104/199] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:03.122555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 96/200] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:02 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:03.128212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66738b64-dcca-443b-988d-114979379148 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:03.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.132930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.134034 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.153560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:03.154699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:03.256527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 97/201] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:03.290879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66738b64-dcca-443b-988d-114979379148 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:03.331001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:03.339053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:03.339805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.340088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.340360 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.341089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=4aaf807ff32642e8ad2e6e4384b0d8a4) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:03.341422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:03.342917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:03.353552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 105/202] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:03 2022] GET /identity/v3/role_assignments?user.id=4aaf807ff32642e8ad2e6e4384b0d8a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=4203118e6def4ea283ce4c49694a4892 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:03.538817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:03.548844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:03.680129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670f00-560c-4a63-922b-56e775d95d4c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:03.714847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:03.715742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.716161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.716580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.727824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:03.733792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:03.734841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:03.736417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:03.738258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 98/203] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:03.745298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:03.891212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b38-196d-4f13-aa06-3fe02486154f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:03.939539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:03.940068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:03.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:03.940611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:03.941293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:03.941598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:03.942966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:03.956302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 106/204] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:03.961575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:04.061732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:04.112651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87acd9-b833-4b4c-ae03-9f7a83400caf None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:04.162767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:04.163401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:04.163676 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:04.163945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] PATH_INFO: `/v3/users/49a8ee03bd924981a929c37387456293` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:04.165090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] RBAC: Authorizing `identity:get_user(user_id=49a8ee03bd924981a929c37387456293)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:04.166575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:04.168141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 99/205] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:03 2022] GET /identity/v3/users/49a8ee03bd924981a929c37387456293 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:04.174182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:04.246772 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:04.299969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6f00-2e6d-4441-946d-07f6b2808924 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:04.350837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:04.351506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:04.351788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:04.352055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:04.444545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:04.446047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:04.528828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:04.575278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 107/206] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:04.581479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:04.699366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718bad-a092-46f8-bf59-fe73829d3497 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:04.747375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:04.748177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:04.748463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:04.748735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:04.750012 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:04.752000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de319772-1bb1-4847-be36-957a4c026748 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:04.753688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 100/207] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:04 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:04.759431 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:04.866913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700380f-b452-43c6-a964-32193a8dd491 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:04.908763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:04.909381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:04.909661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:04.909930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:04.910655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, scope.project.id=7e6f0bf927d041589f84640793ed1e67, user.id=49a8ee03bd924981a929c37387456293) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:04.910962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:04.912461 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebf75-8d07-463e-8178-f47f70e6fabf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:04.918762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 108/208] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:04 2022] GET /identity/v3/role_assignments?user.id=49a8ee03bd924981a929c37387456293&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:05.290326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7d4f6-63b4-4304-b9dd-0198937be344 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.290660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7d4f6-63b4-4304-b9dd-0198937be344 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.290856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7d4f6-63b4-4304-b9dd-0198937be344 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.292250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 101/209] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:05.297812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8c258-ae3d-41f8-97e2-86b94fccdbde None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.298100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8c258-ae3d-41f8-97e2-86b94fccdbde None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.298375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8c258-ae3d-41f8-97e2-86b94fccdbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.321447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e5d8c258-ae3d-41f8-97e2-86b94fccdbde None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:05.322630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e5d8c258-ae3d-41f8-97e2-86b94fccdbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:05.347060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:05.412064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 109/210] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:05.681765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495046-a916-4163-93c7-2d360b63846a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.682159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495046-a916-4163-93c7-2d360b63846a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.682376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495046-a916-4163-93c7-2d360b63846a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.683733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 102/211] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:05.689018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e0c43-163b-4a7c-a7cd-e6c1d38e0050 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.689333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e0c43-163b-4a7c-a7cd-e6c1d38e0050 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.689613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e0c43-163b-4a7c-a7cd-e6c1d38e0050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.699270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495046-a916-4163-93c7-2d360b63846a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:05.702155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:05.712723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-779e0c43-163b-4a7c-a7cd-e6c1d38e0050 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:05.713953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-779e0c43-163b-4a7c-a7cd-e6c1d38e0050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:05.788619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 110/212] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:05.790077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe743d-a08f-42bb-baf8-e3b6ead0041e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.790077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe743d-a08f-42bb-baf8-e3b6ead0041e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.790329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe743d-a08f-42bb-baf8-e3b6ead0041e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.791534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 111/213] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:05.796682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208d34-2049-41bf-924c-872db8df4333 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.797066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208d34-2049-41bf-924c-872db8df4333 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.797465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208d34-2049-41bf-924c-872db8df4333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.815881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-82208d34-2049-41bf-924c-872db8df4333 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:05.817337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-82208d34-2049-41bf-924c-872db8df4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:05.825985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495046-a916-4163-93c7-2d360b63846a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:05.868610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:05.869748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:05.870181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:05.870739 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:05.883221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:05.891025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:05.892420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:05.893197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 103/214] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:05.893866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 112/215] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:05.900839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:05.976024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.016539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c71e7-a6a7-4762-860c-5d0231758e1f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.036810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b3e4-9484-4838-bdbd-6cf4c3efa01e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.037449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b3e4-9484-4838-bdbd-6cf4c3efa01e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.037991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b3e4-9484-4838-bdbd-6cf4c3efa01e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.039527 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 113/216] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:06.044625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.044977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.045346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.055648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.056253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.056529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.057093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.057799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:06.058101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.059614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.065750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:06.067148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:06.068767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 104/217] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:06.069595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.075725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.141074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 114/218] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:06.149560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.174341 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2a6f-1e95-46a9-bc88-af273232b291 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.201168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.214604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.215306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.215819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.215819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.216936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.218484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.220248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 105/219] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:06.220881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.260599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb960f-032c-4fe3-a8c6-586bfa6b935e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.297880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.298868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.299150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.299421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] PATH_INFO: `/v3/users/e0d16f6c400348548bb8ef0b264369a4` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.312470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.316107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d16f6c400348548bb8ef0b264369a4)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.317650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.321864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea086-b78a-4c21-a064-bb9827939514 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.324733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 115/220] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/users/e0d16f6c400348548bb8ef0b264369a4 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:06.325209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.356889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.357545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.357827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.358099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.368696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:06.374039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:06.374912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:06.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 106/221] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:06.380580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.434514 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83e588-e0f6-4b2b-8845-c2ddcb9cfd96 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.436829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.468317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.468909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.469181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.469535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.470686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.472121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.482631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df146c12-1bd3-4337-8648-6e659cf23e23 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.493314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 116/222] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:06 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:06.494137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.530121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.530654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.530925 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.531219 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.560675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.610520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.612079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.614605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8591-d4ba-4003-b177-b593e0b9b4d5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.656614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.657391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.657668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.657948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.659094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:06.659398 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.661170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.671247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 117/223] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:06.671976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.677288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.731777 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 107/224] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:06.732423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.804750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7910d-5427-4b6f-9a43-1a5f209e3d33 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.824378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:06.845228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.846067 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.846347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.846619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.859159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:06.860018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bef8a-b539-4753-947a-d9d1b6bdc66a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:06.864537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:06.865451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:06.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:06.867384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 118/225] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:06.867976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.902521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:06.903155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:06.903429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:06.903698 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:06.904847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:06.906368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:06.908559 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 108/226] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:06.909333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:06.934425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:07.004538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0b61-863c-458b-b91d-047a3b9b9896 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.023727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ef83-239b-447d-b98d-464a83c4521b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.049488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.050127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.050663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.050939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.052775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.055377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.057904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 119/227] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.058809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.063139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.063767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.064047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.064320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.065001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:07.065325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.066823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.076292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 109/228] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.077115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.134697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:07.170308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:07.189542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a639-779c-4c46-88c1-54cc4111a721 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.191265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07330f-8b74-4650-8ab6-03fc34cb4650 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.227915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.228529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.228807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.228969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.229640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.229832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=e0d16f6c400348548bb8ef0b264369a4) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:07.229932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.230140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.230245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.231298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.231677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.232722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.234585 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 120/229] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:07 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.235896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.244231 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 110/230] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:07 2022] GET /identity/v3/role_assignments?user.id=e0d16f6c400348548bb8ef0b264369a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=509124be46144611a84fe7272045de87 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.245068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.436596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d404e9-6d23-40de-9645-e5ed29d76423 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.467800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539490ad-7a15-426b-a975-0c159c848a2b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.496241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:07.515297 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.516252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.516727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.517135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/4aaf807ff32642e8ad2e6e4384b0d8a4/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.519205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, user_id=4aaf807ff32642e8ad2e6e4384b0d8a4, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.520806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.528938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.529805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.530265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.530674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.532531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.537562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.540600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 111/231] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:07 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/4aaf807ff32642e8ad2e6e4384b0d8a4/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:07.542645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 121/232] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:07 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.550544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.561697 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:07.667052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84778b05-4d09-421b-8dd8-9141ecd6157b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.708511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.709162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.709516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.709783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.714043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.715589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0984b-ed63-4373-b46b-25665971655b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.717812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 112/233] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:07 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:07.723852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:07.869571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0239-517a-46e6-bb2b-898b4c7f8fe7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:07.906677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:07.907434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:07.907713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:07.907989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/4aaf807ff32642e8ad2e6e4384b0d8a4/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:07.910294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, user_id=4aaf807ff32642e8ad2e6e4384b0d8a4, role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:07.911750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca06f6-dd38-4786-920a-671c148832aa None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:07.929094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 122/234] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:07 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/4aaf807ff32642e8ad2e6e4384b0d8a4/roles/4203118e6def4ea283ce4c49694a4892 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:09.211513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70319a-ff28-4f11-a2dd-8be777bcc106 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.212064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70319a-ff28-4f11-a2dd-8be777bcc106 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.212064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70319a-ff28-4f11-a2dd-8be777bcc106 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.213557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 113/235] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:09.219139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3eaba-381b-4877-8ee8-ece8a5134e7f None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.219625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3eaba-381b-4877-8ee8-ece8a5134e7f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.219721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3eaba-381b-4877-8ee8-ece8a5134e7f None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.221389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 123/236] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:09.223252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.224210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.228321 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c71c9-de1b-4607-a58d-74893d5c1f7c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.228851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c71c9-de1b-4607-a58d-74893d5c1f7c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.229364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c71c9-de1b-4607-a58d-74893d5c1f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.256320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-1f0c71c9-de1b-4607-a58d-74893d5c1f7c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:09.257532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1f0c71c9-de1b-4607-a58d-74893d5c1f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:09.270086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:09.271267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:09.321618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:09.379897 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 114/237] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:09.399734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 124/238] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:09.739874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:09.743430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:09.788346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995912-9c69-4910-b10f-e59351976d06 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.788346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995912-9c69-4910-b10f-e59351976d06 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.788346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995912-9c69-4910-b10f-e59351976d06 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.788346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 125/239] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:09.789511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9995912-9c69-4910-b10f-e59351976d06 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:09.869105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2dfdb-ccd6-441c-b3b8-7ccd151eb905 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:09.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:09.905573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.906058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.906542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.918012 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:09.921747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9995912-9c69-4910-b10f-e59351976d06 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-5eb1fcd3-227a-4624-9757-0a83537ff9f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:09.923932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:09.924791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:09.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:09.927840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 115/240] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:09.933676 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.934288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.934756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.953375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:09.954940 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:09.962100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:09.962727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:09.963004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:09.963782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:09.964944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:09.966922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:09.969805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 126/241] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:09.970581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.018424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:10.046265 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:10.059585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 116/242] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:10.060261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.112208 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ef15b-fb46-450b-ba18-4036a564b0c1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:10.185479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:10.187007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.187805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.188617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.190156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:10.194140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:10.195781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:10.208102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 127/243] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:10.216210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.225852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879b797-4d6f-4c54-98be-67bab605d3ff None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:10.294492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:10.295474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.296005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.296461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.297400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:10.299022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7344fff-49a1-4f28-8e3e-bacb9e8b64d8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:10.337005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 117/244] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:10 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:10.373088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30be48-a079-44da-ac89-9a55c62c6100 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.373615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30be48-a079-44da-ac89-9a55c62c6100 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30be48-a079-44da-ac89-9a55c62c6100 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.375589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 118/245] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:10.382926 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.383459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.383868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.417348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:10.417348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:10.442840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acc11-9db0-4e23-a78e-be88b996d37b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:10.445850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:10.520392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:10.521022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.521330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.521604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] PATH_INFO: `/v3/users/aeb43c37942e4e87ba8841adcc49e77c` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.545135 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] RBAC: Authorizing `identity:get_user(user_id=aeb43c37942e4e87ba8841adcc49e77c)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:10.546720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:10.549651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 128/246] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:10 2022] GET /identity/v3/users/aeb43c37942e4e87ba8841adcc49e77c => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:10.550534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.565549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:10.619820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 119/247] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:10.621152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.749351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5202f61-b5b1-4a6f-be45-c733f3bb39ee None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:10.832136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098002b-54d7-487f-ba34-a9a98dee1d43 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:10.838267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:10.838918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.839199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.839472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.856083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2920534f-182c-452b-b2f9-3bc9c764d99c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:10.861645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:10.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:10.863302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 129/248] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:10.864866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fbe1-17a3-4781-8e1c-2b012563bfee None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.864866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fbe1-17a3-4781-8e1c-2b012563bfee None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.864866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fbe1-17a3-4781-8e1c-2b012563bfee None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.871793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 130/249] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:10.872600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116fbe1-17a3-4781-8e1c-2b012563bfee None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:10.898038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:10.899310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:10.901374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:10.902307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:10.927317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:10.975798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.028370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.031195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.071271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116fbe1-17a3-4781-8e1c-2b012563bfee None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.120091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.121173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.121721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.121721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.122384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:11.122684 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.124076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b6fa9-58fc-4897-9d26-58a155c9a9ae None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.133166 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 131/250] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.134432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.134540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.134752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.158619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:11.159856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:11.191499 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 120/251] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:11.193142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.232255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 132/252] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:11.232988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.267996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.288562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.310491 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35b3c-290f-4e4c-a286-bb07c387c29c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.349499 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.350321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.350611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.350869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.362374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:11.367956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:11.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:11.369637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 121/253] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:11.370341 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.483808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ea99b-adb0-499d-b51f-b8587e83c107 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.487354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933721f-a49e-462c-9891-4d4f6c39131f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.522638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.523264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.523584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.523858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.525151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.527009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.528928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 122/254] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.529778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.542103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.578062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.579740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.580218 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.580680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] PATH_INFO: `/v3/users/e0d16f6c400348548bb8ef0b264369a4` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.586186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d16f6c400348548bb8ef0b264369a4)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.588064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.590156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 133/255] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/users/e0d16f6c400348548bb8ef0b264369a4 => generated 297 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.591370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.648454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff586-98e4-4d9f-9e4d-f5eba22a1a0c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.689906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.690506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.690781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.690892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.691050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.691932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:11.692229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.694334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.704853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 123/256] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.705715 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.714032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929454b-90a4-407f-b6eb-f3f8bef94f85 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.757440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.758390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.758672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.758943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.759970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=aeb43c37942e4e87ba8841adcc49e77c) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:11.760280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.762540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.770651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 134/257] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/role_assignments?user.id=aeb43c37942e4e87ba8841adcc49e77c&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.771627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.787755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:11.824643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a435c7-cd60-4ca9-9e01-2877ecc00d39 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.862612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.863263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:11.863586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:11.863860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:11.864994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:11.866835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:11.868524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 124/258] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:11.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:11.932346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53648-ede8-4683-81a3-a6fe93e9cf2c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:11.999072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:11.999705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.000008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.000278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.014343 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:12.024123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:12.025038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:12.025936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 135/259] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:12.026576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.033931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:12.064694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5cb8-acb0-48bc-9d10-b4c3a707affd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:12.131936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:12.132568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.133083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.133378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.135564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:12.137299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:12.138898 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 125/260] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:11 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:12.139643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.150120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:12.201372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e6-ca85-486b-ade8-cd90b5ba0cbd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:12.277482 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:12.278945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.278945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.278945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/e0d16f6c400348548bb8ef0b264369a4/roles/509124be46144611a84fe7272045de87` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.281192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, user_id=e0d16f6c400348548bb8ef0b264369a4, role_id=509124be46144611a84fe7272045de87)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:12.283444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:12.294303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2243efa-0f7c-494a-a0d9-4bff355da528 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:12.314851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 136/261] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:12 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/e0d16f6c400348548bb8ef0b264369a4/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:12.315742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.374040 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:12.374673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.374960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.375237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.376022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:12.376331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:12.377789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:12.408103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 126/262] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:12.414314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.430005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:12.503004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea603d0-4add-4978-b9d8-4f653cb2e5f5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:12.554815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:12.579869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:12.580479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.580755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.581027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.619123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223fa8-f05c-4027-a4ad-c21ebd4568f9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:12.697155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:12.697891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:12.698168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:12.698487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] PATH_INFO: `/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:12.702118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] RBAC: Authorizing `identity:get_user(user_id=4aaf807ff32642e8ad2e6e4384b0d8a4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:12.703629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:12.705585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 127/263] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:12 2022] GET /identity/v3/users/4aaf807ff32642e8ad2e6e4384b0d8a4 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:12.708907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:12.710670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:12.711102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.820128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:12.888314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 137/264] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:12.897071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:12.919681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a099-dbf5-4932-a6db-a2e32d20894e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:13.001459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:13.002449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.002914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.003368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.009452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:13.081165 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a65d87-3a0e-4cc5-8d91-ee6fb760f493 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:13.121408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:13.122237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.122522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.123164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.124495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:13.127015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:13.129364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 138/265] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:12 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:13.142840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:13.150105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:13.151588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41cb37-effd-4040-b172-c81285086936 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:13.204336 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:13.329663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb79d-b862-4f4b-974d-a1aa2823033a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:13.362709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 128/266] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:25:13.365466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431566cd-6495-4977-8044-b7816f17ba51 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.365947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431566cd-6495-4977-8044-b7816f17ba51 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.366479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431566cd-6495-4977-8044-b7816f17ba51 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.368203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 129/267] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:13.369498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b585d2-605c-4ff0-b5a0-e044838215b7 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.369987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b585d2-605c-4ff0-b5a0-e044838215b7 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.370446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b585d2-605c-4ff0-b5a0-e044838215b7 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.375880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:13.375880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.375880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.375880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.376231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=4aaf807ff32642e8ad2e6e4384b0d8a4) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:13.376231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:13.376590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 130/268] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:13.377049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fdefa-0778-4a8c-8cd0-7620c866b358 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:13.377807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b585d2-605c-4ff0-b5a0-e044838215b7 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:13.384159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 139/269] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:13 2022] GET /identity/v3/role_assignments?user.id=4aaf807ff32642e8ad2e6e4384b0d8a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:13.392554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def9c-486d-4c0f-9fad-38df6867cb9a None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.392915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def9c-486d-4c0f-9fad-38df6867cb9a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.393194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092def9c-486d-4c0f-9fad-38df6867cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.437153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-092def9c-486d-4c0f-9fad-38df6867cb9a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:13.438680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-092def9c-486d-4c0f-9fad-38df6867cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:13.455371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:13.577379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 140/270] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:13.579252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.579537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.579812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.589991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b585d2-605c-4ff0-b5a0-e044838215b7 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:13.614370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:13.616826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:13.642946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:13.644010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.644498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.644954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.646581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:13.648544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:13.650753 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 131/271] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:13 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:13.656146 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:13.665797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:13.722402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 141/272] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:13.841869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317c51b-54e0-48e4-bb55-79b08be8bc85 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:13.845013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:13.877873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:13.878393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:13.878665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:13.878930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:13.879651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=4aaf807ff32642e8ad2e6e4384b0d8a4) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:13.880011 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:13.881406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:13.889842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 132/273] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:13 2022] GET /identity/v3/role_assignments?user.id=4aaf807ff32642e8ad2e6e4384b0d8a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=4203118e6def4ea283ce4c49694a4892 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:13.945545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.020936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.057668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e00dd2-131e-4c51-80f2-ab72cc8e2d39 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.104265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.104776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.105293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.110501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:14.112396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:14.114551 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 142/274] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:14.121671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.168617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:14.201705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114f5c-99f6-4703-bab2-fa032271e3ae None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.253146 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.253826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.254103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.254374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.266802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:14.272210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:14.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:14.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:14.275358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97235ec-565a-44b4-a899-3b2dc4886b8a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.275431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 133/275] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:14.279549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.314999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:14.320428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.321235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.321542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.321821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.322673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:14.324971 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:14.353727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 143/276] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:14 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:14.408301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20daa4-aca7-43c6-8655-d1216a9a4aa3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.451695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.452661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.453131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.454219 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.455149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:14.455644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:14.457424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d65b6-587c-4999-b498-1c76df651abb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:14.468417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 134/277] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:14.474104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.574995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:14.596414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d07246-98ca-4a84-b9f4-03590fe3dc78 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.600588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420eaa3-8f2e-490c-bc57-2c514d01140c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.600872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420eaa3-8f2e-490c-bc57-2c514d01140c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.601197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420eaa3-8f2e-490c-bc57-2c514d01140c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.602829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 135/278] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:14.607583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.607858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.608121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.630099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:14.631120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:14.645765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.646398 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.646674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.646946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] PATH_INFO: `/v3/users/94219ab356684537895917ab07f89857` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.664192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] RBAC: Authorizing `identity:get_user(user_id=94219ab356684537895917ab07f89857)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:14.665925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:14.670643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 144/279] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:14 2022] GET /identity/v3/users/94219ab356684537895917ab07f89857 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:14.673869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:14.723607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 136/280] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:14.795995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223795-5b4c-4af9-9bc9-2a33d5e16931 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:14.833095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:14.833731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:14.834007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:14.834278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:14.835009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, user.id=94219ab356684537895917ab07f89857, scope.system=all) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:14.835316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:14.836824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:14.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 145/281] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 30 09:25:14 2022] GET /identity/v3/role_assignments?user.id=94219ab356684537895917ab07f89857&scope.system=all&role.id=509124be46144611a84fe7272045de87 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:15.018955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.045674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:15.159331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dcfba-9f94-4947-81ac-0520f22bea9c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:15.197941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:15.198571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.198850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.199121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.215818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-79d1e642-1cfe-4f04-93ca-273d7a358bd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:15.221303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:15.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:15.222951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 137/282] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:15.229937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.233129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:15.276473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d074e-48c8-499d-aef7-405599175911 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.276658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d074e-48c8-499d-aef7-405599175911 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.276939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d074e-48c8-499d-aef7-405599175911 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.278329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 138/283] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:15.295001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.295291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.295565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.338268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:15.339541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:15.351635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae29-b8da-4de0-8acc-5af6be504d23 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:15.394271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:15.395256 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.395725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.396251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.396924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:15.397328 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:15.398702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:15.410178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 146/284] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:15.420193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.442639 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 139/285] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 30 09:25:15.499291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:15.545195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593b62-542e-4023-ae42-beb560a8a43b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:15.583338 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:15.583968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.584243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.584512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] PATH_INFO: `/v3/users/aeb43c37942e4e87ba8841adcc49e77c` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.585660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] RBAC: Authorizing `identity:get_user(user_id=aeb43c37942e4e87ba8841adcc49e77c)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:15.587091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:15.588963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 147/286] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:15 2022] GET /identity/v3/users/aeb43c37942e4e87ba8841adcc49e77c => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:15.594339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.609050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:15.725869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1faaa-d769-4c10-a31d-16fefc310b1a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:15.773182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:15.773852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.774130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.774405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.775656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:15.776561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.777284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:15.778919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 140/287] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:15 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:15.791484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:15.924947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:15.950962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b448657-44df-4585-9201-ff4cec13c4f1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:15.986825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:15.987477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:15.987757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:15.988029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/aeb43c37942e4e87ba8841adcc49e77c/roles/c0b43d11d58e4726ae8bd6e73eb7154b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:15.990067 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, user_id=aeb43c37942e4e87ba8841adcc49e77c, role_id=c0b43d11d58e4726ae8bd6e73eb7154b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:15.991705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:16.003347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303e8c6-d8d0-4ec8-9f8e-bbba93d4ca32 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:16.006757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 141/288] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:15 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/users/aeb43c37942e4e87ba8841adcc49e77c/roles/c0b43d11d58e4726ae8bd6e73eb7154b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:25:16.064853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:16.074070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:16.074740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:16.075026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:16.075308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:16.091214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:16.096807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:16.097777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:16.098668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 148/289] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:16.105496 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:16.257622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c53a-995c-4b37-af52-7439b76f46e3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:16.298578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:16.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:16.299473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:16.299744 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:16.300427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:16.300729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:16.302450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:16.308043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:16.312111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 142/290] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:16.318053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:16.451299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c922-4df4-4a0c-85a7-98bbfc665fa0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:16.485980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:16.486608 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:16.486888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:16.487163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] PATH_INFO: `/v3/users/e0d16f6c400348548bb8ef0b264369a4` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:16.488335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d16f6c400348548bb8ef0b264369a4)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:16.489814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:16.491572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 149/291] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:16 2022] GET /identity/v3/users/e0d16f6c400348548bb8ef0b264369a4 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:16.496889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:16.649431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb3e-f2af-490a-9a9a-a0b8ffbfba8b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:16.693085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:16.693719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:16.694000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:16.694276 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:16.782771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:16.785805 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:16.787473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:16.910422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:16.915837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:16.998434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:17.041163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb566-dcfb-4fed-867f-5a92e442e756 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:17.076655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:17.077312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.077597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.077871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.079533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:17.081033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d209e-0454-47c6-8e80-a469a0c0f112 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:17.082997 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 150/293] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:16 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:17.088792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:17.212967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:17.216647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233d034-0740-4bdb-b1b9-be201e6d412b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:17.254254 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:17.255203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.255681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.256148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.257092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=e0d16f6c400348548bb8ef0b264369a4) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:17.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:17.259273 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbef8b5-a5bc-4d14-b101-a96295b346fb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:17.266213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 144/294] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:17 2022] GET /identity/v3/role_assignments?user.id=e0d16f6c400348548bb8ef0b264369a4&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=509124be46144611a84fe7272045de87 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:17.347621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1913-ef32-4a9c-869a-90527cf1c0b8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.347953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1913-ef32-4a9c-869a-90527cf1c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.348174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1913-ef32-4a9c-869a-90527cf1c0b8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.349696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 151/295] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:17.355582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b32bd-9b29-4696-b0cf-7651838699d2 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.356157 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b32bd-9b29-4696-b0cf-7651838699d2 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.356654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b32bd-9b29-4696-b0cf-7651838699d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.390574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7b3b32bd-9b29-4696-b0cf-7651838699d2 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:17.392293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7b3b32bd-9b29-4696-b0cf-7651838699d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:17.474976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0611de-535f-4c37-abe0-48b981781752 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.475183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0611de-535f-4c37-abe0-48b981781752 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.475449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0611de-535f-4c37-abe0-48b981781752 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.476881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 152/296] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:17.487455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944c8b-bdcb-4faa-b83b-265385defbe9 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.487679 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944c8b-bdcb-4faa-b83b-265385defbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.487953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944c8b-bdcb-4faa-b83b-265385defbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.503443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 145/297] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:17.526345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f1944c8b-bdcb-4faa-b83b-265385defbe9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:17.527546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f1944c8b-bdcb-4faa-b83b-265385defbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:17.597719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960109-ccb9-4a72-baf2-d408830504a6 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.598147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:17.598576 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960109-ccb9-4a72-baf2-d408830504a6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.598997 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c960109-ccb9-4a72-baf2-d408830504a6 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.600530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 146/299] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:17.606291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.606759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.607220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.625876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:17.627280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:17.683910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:17.698387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 154/300] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:17.812845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c960109-ccb9-4a72-baf2-d408830504a6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:17.899910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:17.918024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:17.934894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c960109-ccb9-4a72-baf2-d408830504a6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:17.972741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:17.973398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:17.973680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:17.973956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:17.975078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:17.976522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:17.978392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 147/301] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:17.983860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.021004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7bec-f6e2-4ae9-bd2f-d0d0453dc91a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.062249 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.062955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.063177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.063447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.074263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:18.079077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:18.079990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:18.080784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 155/302] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:18.081740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.093689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264fd97-391f-4353-a6cb-bfd93b316520 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.129541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.130144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.130481 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.130762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] PATH_INFO: `/v3/groups` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.131301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.132729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.135660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.148541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 148/303] 10.222.0.25 () {60 vars in 1134 bytes} [Fri Sep 30 09:25:17 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:25:18.149753 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.184134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.212853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b84-341e-479a-8655-5da64bde1a71 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.255922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.256564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.256846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.257123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.271022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:18.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:18.277815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:18.278715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 156/304] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:18.286633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.294210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6b5dd-b621-4a72-949e-d8565ea62e00 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.334484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.335192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.335573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.335949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.336720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:18.337344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.338735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.348242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 149/305] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:18.353948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.413842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5b50e-5ccd-4f70-903a-be544b414d69 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.427400 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.457011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.457643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.458032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.458303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.458975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:18.459277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.460826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.461106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.470974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 157/306] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:18.476633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.480691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17ca23-ff9f-44cd-a2a8-2cd1ba0780b7 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.522013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.522713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.522902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.523266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] PATH_INFO: `/v3/users/6372e1ac74d641d9a17acf45e4c4287b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.537959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] RBAC: Authorizing `identity:get_user(user_id=6372e1ac74d641d9a17acf45e4c4287b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.539595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.541403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 150/307] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/users/6372e1ac74d641d9a17acf45e4c4287b => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:18.547924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.602928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0edfc-d629-4a5e-9b6b-971be79199e3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.641642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.642689 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.643147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.643646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] PATH_INFO: `/v3/users/94219ab356684537895917ab07f89857` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.644972 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] RBAC: Authorizing `identity:get_user(user_id=94219ab356684537895917ab07f89857)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.646717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.648479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 158/308] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/users/94219ab356684537895917ab07f89857 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:18.654743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:18.665230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc198-5317-4e16-b85e-66ce0fe87391 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.711897 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.712509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.712786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.713059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.713511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.713832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, user.id=6372e1ac74d641d9a17acf45e4c4287b, scope.system=all) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:18.714153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.716104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5dff-a1e4-42f2-9296-c737347a58a7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.729289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 151/309] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 30 09:25:18 2022] GET /identity/v3/role_assignments?user.id=6372e1ac74d641d9a17acf45e4c4287b&scope.system=all&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:18.796051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ed10-ba37-496f-aff8-4c69ad6834d4 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.796366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ed10-ba37-496f-aff8-4c69ad6834d4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.796596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0ed10-ba37-496f-aff8-4c69ad6834d4 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.797217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10770bb-40a7-4d26-8067-f1970e29202f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:18.798401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 152/310] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:18.804062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.804364 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.804611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.821650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:18.837518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:18.837518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:18.842448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:18.843399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:18.843878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:18.845026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] PATH_INFO: `/v3/system/users/94219ab356684537895917ab07f89857/roles/509124be46144611a84fe7272045de87` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:18.847297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=94219ab356684537895917ab07f89857, role_id=509124be46144611a84fe7272045de87)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:18.849850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:18.861955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 159/311] 10.222.0.25 () {58 vars in 1334 bytes} [Fri Sep 30 09:25:18 2022] PUT /identity/v3/system/users/94219ab356684537895917ab07f89857/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:18.926623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 153/312] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:19.203723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:19.306309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024634aa-7183-4376-b2f5-32f854407761 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:19.307776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:19.344130 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:19.345115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:19.345633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:19.346100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:19.356740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:19.362750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:19.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:19.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:19.366897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 160/313] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:19.372408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:19.473245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd26341-fff6-4df1-b64a-c8d54c683578 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:19.512282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:19.512888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:19.513165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:19.513461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:19.514132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:19.514432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:19.515830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:19.518094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:19.524741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 154/314] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:19.530596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:19.634864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b254b87-8303-4438-90f2-54f3a23b1286 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:19.672415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:19.673445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:19.673923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:19.674403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] PATH_INFO: `/v3/users/aeb43c37942e4e87ba8841adcc49e77c` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:19.675738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] RBAC: Authorizing `identity:get_user(user_id=aeb43c37942e4e87ba8841adcc49e77c)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:19.677409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:19.679196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 161/315] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:19 2022] GET /identity/v3/users/aeb43c37942e4e87ba8841adcc49e77c => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:19.685853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:19.791569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ebe7-cdf7-4534-9e5b-bc60582f9c9d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:19.826132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:19.826979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:19.827475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:19.827939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:19.894448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:19.895882 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:19.897557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:20.001136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 155/316] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:20.006559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:20.039271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:20.117851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402de1c-862e-4535-8ffd-df51f4080a79 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:20.153823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:20.154784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.155286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.155780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.157353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:20.159029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b59f9-6f32-48f5-9a7f-fe428dae8eab None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:20.161333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 162/317] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:20 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:20.173533 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:20.270971 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:20.275558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aed72-1e0a-4773-8af0-7aaaa4c5ab8c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:20.312643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:20.313509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.313960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.314388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.315269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85, user.id=aeb43c37942e4e87ba8841adcc49e77c) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:20.315714 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:20.317310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e755a-762f-479b-ace6-fe00cbebff5f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:20.323924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 156/318] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:20 2022] GET /identity/v3/role_assignments?user.id=aeb43c37942e4e87ba8841adcc49e77c&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:20.598308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011d3e-58fa-44a3-b717-ccfd5e580eda None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.598813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011d3e-58fa-44a3-b717-ccfd5e580eda None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.598888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011d3e-58fa-44a3-b717-ccfd5e580eda None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.600232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 163/319] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:20.605561 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1477-a53c-41ed-a4f1-6c550e522c36 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.606007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1477-a53c-41ed-a4f1-6c550e522c36 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1477-a53c-41ed-a4f1-6c550e522c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.624217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-975f1477-a53c-41ed-a4f1-6c550e522c36 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:20.626197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-975f1477-a53c-41ed-a4f1-6c550e522c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:20.695884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 157/320] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:20.963772 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011d3e-58fa-44a3-b717-ccfd5e580eda None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:20.968112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da756a26-d08e-45b5-b2a4-8476fe72b06d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.968487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da756a26-d08e-45b5-b2a4-8476fe72b06d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.969284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da756a26-d08e-45b5-b2a4-8476fe72b06d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.971071 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 158/321] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:20.977909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd399cd-c869-45b9-ada7-444c56d62ac5 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:20.978586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd399cd-c869-45b9-ada7-444c56d62ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:20.978871 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd399cd-c869-45b9-ada7-444c56d62ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:20.998378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-9bd399cd-c869-45b9-ada7-444c56d62ac5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:20.999568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9bd399cd-c869-45b9-ada7-444c56d62ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:21.075957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011d3e-58fa-44a3-b717-ccfd5e580eda None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.077396 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 159/322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:21.082978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.086873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111d08-de65-4e98-a427-ca0c6fc3969f None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.087159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111d08-de65-4e98-a427-ca0c6fc3969f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.087432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111d08-de65-4e98-a427-ca0c6fc3969f None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.089002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 160/323] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:21.094265 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.094543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.094823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.112810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.113099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:21.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.114299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:21.114612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.115089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.116344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:21.117965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:21.119697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 164/324] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:21.125080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.132928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.183454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 161/325] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:21.231468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385e91-1c30-4eb8-b62b-d403c1f005d2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.265383 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.266564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.266839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.267101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] PATH_INFO: `/v3/groups` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.267715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:21.269128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:21.285429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 165/326] 10.222.0.25 () {60 vars in 1134 bytes} [Fri Sep 30 09:25:21 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:25:21.337290 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.449614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4c34-47b3-462e-a676-d801fa86ed5d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.455008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.488250 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.492507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.493152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.493519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.493799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.506155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:21.512038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:21.512956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:21.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 162/327] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:21.519693 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.539360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.579236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007cde8-00b6-4877-96b4-57366beb6c2a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.626462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.627067 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.627140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.627405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.643223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:21.648942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:21.649824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:21.650613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 166/328] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:21.655894 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.663826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326d9c-8527-4efa-acb1-8e70468837ef None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.714403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.715329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.715613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.716162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.716857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:21.717149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:21.719745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:21.736064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 163/329] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:21.742243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.778921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.796727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787e24-1e72-479e-ab90-cc08ec09e72d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.838381 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:21.839267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.840309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.841189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.841744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.842967 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:21.844503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:21.846587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:21.856827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 167/330] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:21.863189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:21.872950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090533-c471-48f8-a610-7d7945eaf980 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:21.919686 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:21.920351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:21.920626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:21.920896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] PATH_INFO: `/v3/users/6372e1ac74d641d9a17acf45e4c4287b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:21.922644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] RBAC: Authorizing `identity:get_user(user_id=6372e1ac74d641d9a17acf45e4c4287b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:21.924076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:21.929295 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 164/331] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/users/6372e1ac74d641d9a17acf45e4c4287b => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:21.934202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:22.011259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc4ca4-034d-4971-a11d-bc22d31fd4b1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:22.060760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:22.061775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:22.062258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72d58-75e2-48a7-805d-2adc7afdab66 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:22.062487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:22.062970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] PATH_INFO: `/v3/users/94219ab356684537895917ab07f89857` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:22.064603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] RBAC: Authorizing `identity:get_user(user_id=94219ab356684537895917ab07f89857)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:22.066377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:22.068497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:21 2022] GET /identity/v3/users/94219ab356684537895917ab07f89857 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:22.073833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:22.096543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:22.098080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:22.098735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:22.099009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:22.099284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] PATH_INFO: `/v3/system/users/6372e1ac74d641d9a17acf45e4c4287b/roles/c0b43d11d58e4726ae8bd6e73eb7154b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:22.101166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6372e1ac74d641d9a17acf45e4c4287b, role_id=c0b43d11d58e4726ae8bd6e73eb7154b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:22.102923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a62a8e-b147-437e-a7aa-3bc6e2d741f8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:22.113128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 165/333] 10.222.0.25 () {58 vars in 1334 bytes} [Fri Sep 30 09:25:21 2022] PUT /identity/v3/system/users/6372e1ac74d641d9a17acf45e4c4287b/roles/c0b43d11d58e4726ae8bd6e73eb7154b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:22.205317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5cc4e-478d-495c-afc6-7fa1bfb22015 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:22.246295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:22.247316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:22.247825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:22.248362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:22.249388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] RBAC: Adding query filter params (role.id=509124be46144611a84fe7272045de87, user.id=94219ab356684537895917ab07f89857, scope.system=all) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:22.249937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:22.251613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a4e3b-f95e-4364-9e1f-a1a5dafa9f79 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:22.267240 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 169/334] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 30 09:25:22 2022] GET /identity/v3/role_assignments?user.id=94219ab356684537895917ab07f89857&scope.system=all&role.id=509124be46144611a84fe7272045de87 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:23.972795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3604-4b73-455c-926a-2ab8a4a57b7e None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:23.973826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3604-4b73-455c-926a-2ab8a4a57b7e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:23.974324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3604-4b73-455c-926a-2ab8a4a57b7e None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:23.975878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 166/335] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:23.981556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fb88-197c-4dd3-ab23-d83a3135fcfd None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:23.981994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fb88-197c-4dd3-ab23-d83a3135fcfd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:23.982107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fb88-197c-4dd3-ab23-d83a3135fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.004807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e587fb88-197c-4dd3-ab23-d83a3135fcfd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:24.006337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e587fb88-197c-4dd3-ab23-d83a3135fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:24.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 170/336] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:24.512503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb6200-7085-455d-9be7-21e100b04587 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:24.513189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb6200-7085-455d-9be7-21e100b04587 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:24.513484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb6200-7085-455d-9be7-21e100b04587 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.514969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 167/337] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:24.521626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f57c-c160-4fd9-8cd1-4e070f7e16ed None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:24.521954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f57c-c160-4fd9-8cd1-4e070f7e16ed None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:24.522184 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f57c-c160-4fd9-8cd1-4e070f7e16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.531614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:24.548828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-fd81f57c-c160-4fd9-8cd1-4e070f7e16ed None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:24.550086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fd81f57c-c160-4fd9-8cd1-4e070f7e16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:24.639769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb6200-7085-455d-9be7-21e100b04587 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:24.641999 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:24.658425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:24.769070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86243-1646-4545-922f-b46a85302706 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:24.769756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86243-1646-4545-922f-b46a85302706 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:24.770221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86243-1646-4545-922f-b46a85302706 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.772790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 172/339] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:24.781784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:24.782343 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:24.782806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.794226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb6200-7085-455d-9be7-21e100b04587 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:24.824756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:24.825974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:24.856790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:24.861590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:24.861881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:24.862160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:24.884556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:24.892317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:24.893150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:24.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 168/340] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:24.903504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.000964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 173/341] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:25.040912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.086896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ced-c058-4c3d-9765-96b0186bff82 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.131567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:25.132175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.132450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.132721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.133479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:25.133777 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:25.135566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:25.147571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 169/342] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:25.153232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.192872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.236074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.283817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10e22-bccd-4520-8287-3c2450180a76 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.324589 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:25.325754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.327018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.328083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.336311 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4626-fa0e-4109-8141-6ce39c900747 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.396038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.438343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:25.438990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.439268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.439538 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.451571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:25.453940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:25.463623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ae4914e7-7813-401c-9fd0-6cb5a8cbb736 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:25.469326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:25.470182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:25.470957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:25.473985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 170/343] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:25.475424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacfd3-56c6-4d60-a1e1-dc8a3cd20d1c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.475911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacfd3-56c6-4d60-a1e1-dc8a3cd20d1c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.476370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacfd3-56c6-4d60-a1e1-dc8a3cd20d1c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.478054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 171/344] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:25.488278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.489387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.513168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:25.514817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:25.538456 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.595375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 174/345] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:25.596121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.608654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 172/346] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:25.609971 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.757466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dfda8-0ef5-43bd-9a30-00425d00d56f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.760256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d6a03-dd03-47d0-9632-b805543dce27 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.782484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.804820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:25.805457 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.805732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.806007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.806668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:25.806982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:25.807832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:25.808320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:25.808874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.809372 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.810007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.819185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 175/347] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:25.820167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.823180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-137c6a65-a5aa-4e53-8d6d-d010eff9e654 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:25.829752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:25.830748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:25.831566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:25.834553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 173/348] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:25.836603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e2e2-39ac-499e-b5b6-96a3685a5278 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:25.837106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e2e2-39ac-499e-b5b6-96a3685a5278 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:25.837598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354e2e2-39ac-499e-b5b6-96a3685a5278 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:25.839031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 174/349] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:25.840051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354e2e2-39ac-499e-b5b6-96a3685a5278 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:25.861642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:25.956518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d4b2-d8db-4104-9ce0-c98680150c53 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:25.967984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354e2e2-39ac-499e-b5b6-96a3685a5278 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.000923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.003989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.003989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.003989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.003989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.004982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.007354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 176/350] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:26.008509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.013331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.013922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.014203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.014478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.073594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.104821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.106753 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.117615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.128474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a31e-8023-4497-9a62-ccca9118c0e7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.171076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.171718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.171991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.172260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.172920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:26.173221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.174748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114de04-ae20-476f-b42f-17310180f098 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.189432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 177/351] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:26.191080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.191362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.192063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.212472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:26.214225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:26.255532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 175/352] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:26.258123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.302423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 178/353] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:26.303325 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.357546 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.389305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54488b44-98da-4bc9-b3ea-5706d4a4c89b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.435051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.451254 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.452397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.453450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.454267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.456820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0b9a-3ed1-4d16-a154-42cbb7e28391 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.467075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:26.473189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:26.474111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:25:26.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:26.478022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 176/354] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:26.479583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.508668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.509359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.509637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.509912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.521966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.523545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.526216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 179/355] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:26.527068 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.631105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0d76-3259-4025-b09e-e4af69c8edd3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.660150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd00c0-d932-42fb-a45f-688253ca6056 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.671135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.671861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.672197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.672534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.681957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.700598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.701234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.701531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.701793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.703442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.705526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.707165 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 180/356] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:26.708680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.731791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.762890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.764435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.829991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0d27d-45f5-487c-bd96-bfc9394188c2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.871053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 177/357] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:26.872010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.874499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:26.875107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:26.875414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:26.875681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:26.876444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:26.876743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:26.878152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:26.887377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 181/358] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:26.889116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:26.924737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:26.993017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54436f-599d-462e-8557-92ae3f8a9ed4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:26.995199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.019324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b68d-1ed9-4566-93ac-70dee0f6246d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.036213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.036846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.037121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.037503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.038232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=509124be46144611a84fe7272045de87, scope.project.id=7e6f0bf927d041589f84640793ed1e67) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:27.038539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.040017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ee3b-01f7-4c86-a1d7-8b966066fc2f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.046160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 178/359] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=509124be46144611a84fe7272045de87 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.047334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4a14-9356-4101-a14e-7a52e4b6fe8c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.047617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4a14-9356-4101-a14e-7a52e4b6fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.047889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4a14-9356-4101-a14e-7a52e4b6fe8c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.049325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 179/360] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:27.050798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4a14-9356-4101-a14e-7a52e4b6fe8c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.070742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.071381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.071661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.071933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.088194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:27.094384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:27.095317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:27.096113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 182/361] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:27.096779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.208766 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4a14-9356-4101-a14e-7a52e4b6fe8c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.210237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bfe17-9272-4e83-8152-f02c1f5e02f4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.257164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.257832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.258107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.258372 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.259464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.260895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.263083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 180/362] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.264200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.281277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.282009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.282286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.282557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.283683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.285128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b836480-355c-48b6-a549-8883fc539c9b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.286949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 183/363] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.288120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.288256 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.309778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:27.311275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:27.313912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.384419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18131-62fd-4c7e-8f39-83a48c390872 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.413312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:27.413312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.432847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.433596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.434452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.434826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] PATH_INFO: `/v3/users/6372e1ac74d641d9a17acf45e4c4287b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.436287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=6372e1ac74d641d9a17acf45e4c4287b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.438474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.440878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 181/365] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/users/6372e1ac74d641d9a17acf45e4c4287b => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.442205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.494641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.527494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a52ce8-9555-4f1e-a509-e8aaba645e3a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.573654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971277b0-4f29-4396-9633-9d1f0d099ee9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.574156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.574757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.575286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.575560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.577176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:27.578048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.579515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.586128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.591627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 185/366] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.592963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.612085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.612733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.612958 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.613228 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=7e6f0bf927d041589f84640793ed1e67) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:27.614294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.615729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.624101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 182/367] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=4203118e6def4ea283ce4c49694a4892 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.625108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.741318 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47138db0-fd90-4730-bade-6fa0b20f435f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.755041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e1332-301f-4a2f-a96f-e8c58b323c41 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.756778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.792437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.793082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.793397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.793669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.795485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.797015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.799238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:27.799853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:27.800127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:27.800464 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 186/368] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.801376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.805691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:27.806986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] RBAC: Adding query filter params (role.id=c0b43d11d58e4726ae8bd6e73eb7154b, user.id=6372e1ac74d641d9a17acf45e4c4287b, scope.system=all) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:27.806986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:27.808287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:27.823540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 183/369] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/role_assignments?user.id=6372e1ac74d641d9a17acf45e4c4287b&scope.system=all&role.id=c0b43d11d58e4726ae8bd6e73eb7154b => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:27.824478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:27.912537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:27.948174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caca9d-ea7e-46f4-95de-c65995f128ac None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:27.957697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809898-e82b-4717-a8d5-702c4d4672c2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.010503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.011068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.011346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.011873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.016987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.017624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.017902 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.018173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.043012 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:28.049767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:28.050695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:28.051486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 184/370] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:28.052122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.098839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:28.153414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:28.154875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:28.229216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c059e-a6d6-4daf-b241-5dc8b4b2c21a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.242453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:28.276142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.276994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.277580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.277863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.278759 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=509124be46144611a84fe7272045de87, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:28.279072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:28.281185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:28.287982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 187/371] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:28.288314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 185/372] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=509124be46144611a84fe7272045de87 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:28.290104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.295222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.424047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:28.452548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6877-a5b1-4c12-be68-d6d31d5c4684 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.536633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13657dd-c12a-4f44-a828-962f9f6470bf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.539494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.540138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.540469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.540681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:28.550590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:28.552654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 186/373] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:28.557825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.613761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.614377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.614655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.614928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.615603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:28.615904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:28.617311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:28.643094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 188/374] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:28.646386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.701621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:28.765812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625e33-7425-40f7-9990-a409e89dcf5b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.839769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.840410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.840688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.840959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:28.843263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44784-2ab1-4feb-9635-e209fd6e7adb None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:28.843762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:28.845229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:28.847148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 187/375] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:28.861864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:28.900906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:28.910904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:28.911507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:28.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:28.912096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.041514 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cecb-03c1-4efd-9bca-cfe35b2738ab None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:29.052421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:29.053928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:29.106069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:29.106598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.106864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.107124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.108500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:29.108842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:29.110307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:29.113798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:29.122014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 188/376] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=4203118e6def4ea283ce4c49694a4892 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:29.218872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 189/377] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:29.224620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:29.357465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:29.377457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcb33-4447-412c-b86a-54a95b2ce751 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:29.425018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:29.425805 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.426083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.426349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] PATH_INFO: `/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.430037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] RBAC: Authorizing `identity:get_project(project_id=fb557875fa6e42b4902cd1a1d7e26a4b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:29.431624 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:29.433750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 189/378] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:29 2022] GET /identity/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:29.439844 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:29.571929 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6951f1-9520-4dd4-b35f-c39700e4880a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:29.608454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:29.613989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:29.614425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.614924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.615501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] PATH_INFO: `/v3/groups/be9f80ed120b4253a81749fc82acd3cd` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.621450 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] RBAC: Authorizing `identity:get_group(group_id=be9f80ed120b4253a81749fc82acd3cd)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:29.623167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53a70-6008-420b-b5d0-0cc60bd3877f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:29.626003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 190/379] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:29 2022] GET /identity/v3/groups/be9f80ed120b4253a81749fc82acd3cd => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:29.633408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:29.645585 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb104-593e-463c-b28c-330978aa3a28 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.645872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb104-593e-463c-b28c-330978aa3a28 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.646145 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb104-593e-463c-b28c-330978aa3a28 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.647606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 191/380] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:29.653789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8185a-3602-4581-8af3-840f64643335 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.654797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8185a-3602-4581-8af3-840f64643335 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.655082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8185a-3602-4581-8af3-840f64643335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.692882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2da8185a-3602-4581-8af3-840f64643335 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:29.694088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2da8185a-3602-4581-8af3-840f64643335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:29.810154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a0f9-6d0b-4b0e-801c-b6b782dd0521 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:29.829402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 192/381] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:29.865343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:29.865869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:29.866149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:29.866423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:29.867147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] RBAC: Adding query filter params (group.id=be9f80ed120b4253a81749fc82acd3cd, role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=fb557875fa6e42b4902cd1a1d7e26a4b) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:29.867455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:29.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:29.881411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 190/382] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:29 2022] GET /identity/v3/role_assignments?group.id=be9f80ed120b4253a81749fc82acd3cd&scope.project.id=fb557875fa6e42b4902cd1a1d7e26a4b&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:30.178972 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8185a-3602-4581-8af3-840f64643335 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:30.301975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8185a-3602-4581-8af3-840f64643335 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:30.340567 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:30.354183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:30.354825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.355105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.355379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.373048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-19a896a0-274f-4e39-814e-cbc16fa1c076 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:30.378081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:30.378981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:30.379835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 193/383] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:30.385179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:30.417872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:30.427765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac11d7-5ef2-42ef-8264-539c192f507a None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.428090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac11d7-5ef2-42ef-8264-539c192f507a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.428319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac11d7-5ef2-42ef-8264-539c192f507a None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.430578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 194/384] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:30.437606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.438010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.438389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.457082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:30.458467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:30.526272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb38457-3e06-4a1f-a2e0-75d4e8701df6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:30.576931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 195/385] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:30.581278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:30.581890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.582167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.582435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.583101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:30.583398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:30.584760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:30.594554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 191/386] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:30.602386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:30.704888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153a0eb-a165-42b5-9e21-a864bef534ef None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:30.721544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:30.739326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:30.739959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.740237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.740546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.741739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:30.743178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:30.745054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 196/387] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:30 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:30.751709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:30.844608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:30.872907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726d99-5967-4277-b5c5-9778bc3262a0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:30.913832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:30.914458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.914735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.915004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.916117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:30.917561 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184098d7-c061-43b8-84d8-6ddd88035d95 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:30.919170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 192/388] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:30 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:30.925435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:30.953319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed675-d71b-40b1-aebe-776e418fb1c0 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.953651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed675-d71b-40b1-aebe-776e418fb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.953866 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed675-d71b-40b1-aebe-776e418fb1c0 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.955234 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 193/389] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:30.959804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:30.960081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:30.960347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:30.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:30.993092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:31.083910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 194/390] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:31.085150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.099433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec268-354b-4c8e-91e8-72f011c08cd4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.166727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.167380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.167656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.167929 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/509124be46144611a84fe7272045de87` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.170982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, group_id=10fbe205353a4a80a36c76924b2fb6d9, role_id=509124be46144611a84fe7272045de87)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:31.172951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:31.199746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 197/391] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 30 09:25:30 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:31.217438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:31.245877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94faba0-bf7b-4afd-8acf-3b1d4dacc245 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.303230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.303891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.304172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.304443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.319584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:31.324722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:31.325642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:31.326417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 195/392] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:31.332719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.377004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.382640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:31.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99892-6dae-4aaa-ad08-e1c4a5d011d4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.492260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.493201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.493523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.494071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.494757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:31.495063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:31.496532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:31.507442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 198/393] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:31.513638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.542252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892c31b-5245-4d83-bdbe-ea0f95b6b31d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.605796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.606421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.607348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.607819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.615122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:31.634258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:31.639621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:31.640560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:31.641369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:31.644105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 196/394] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:31.648369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.686189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c95ded-122c-4ce4-b586-2e273f9ce357 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.693811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:31.766369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.767423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.767697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.767966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.771055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:31.772492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:31.776934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 199/395] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:31.780248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.811349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e79689-a213-4351-b6e8-62cd9c7604f5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:31.885433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:31.886036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:31.886310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:31.886832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:31.887496 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:31.887786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:31.889147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:31.903811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 197/396] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:31.909729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:31.967778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c9e3-d43d-4521-b6ae-b300a0167748 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.018633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:32.039315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.040005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.040281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.040552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.043051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:32.044504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:32.049817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 200/397] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:32.055094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:32.103383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab271a-8f11-461e-924c-1bd38b749fff None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.105066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:32.169378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.170512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.171136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.171464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.172684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:32.174392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271380a-b3c8-4592-819f-8b6aaa304a9a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:32.176134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 198/398] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:31 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:32.177316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dd4b7-7b04-4cb4-bc15-0e12ece90508 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.181278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dd4b7-7b04-4cb4-bc15-0e12ece90508 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.181278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dd4b7-7b04-4cb4-bc15-0e12ece90508 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.181278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 199/399] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:32.185277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dd4b7-7b04-4cb4-bc15-0e12ece90508 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:32.202380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c900f-92cf-4a01-badf-92be3a8e5481 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.248255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.248910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.249776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.250093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.252422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f0bf927d041589f84640793ed1e67, group_id=10fbe205353a4a80a36c76924b2fb6d9, role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:32.253911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5a8d-1253-41ba-999a-581eb524e4e1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:32.268174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 201/400] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 30 09:25:32 2022] PUT /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/4203118e6def4ea283ce4c49694a4892 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:32.269587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7a54-4161-449c-94a4-ff8d153c8043 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.269895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7a54-4161-449c-94a4-ff8d153c8043 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.270169 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7a54-4161-449c-94a4-ff8d153c8043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.292411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f74c7a54-4161-449c-94a4-ff8d153c8043 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:32.293762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f74c7a54-4161-449c-94a4-ff8d153c8043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:32.307544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dd4b7-7b04-4cb4-bc15-0e12ece90508 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.338895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:32.350855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.352083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.352576 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.353131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.354793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:32.356643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d877169-54fb-455e-9dee-1cfc6c2b8e1c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:32.359583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 200/401] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:32 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:32.366199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b82d-801c-44aa-acfd-c4e5cc74549b None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.366877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b82d-801c-44aa-acfd-c4e5cc74549b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.367351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b82d-801c-44aa-acfd-c4e5cc74549b None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.369213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 201/402] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:32.370268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b82d-801c-44aa-acfd-c4e5cc74549b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:32.376770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 202/403] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:32.384892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.384892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.384892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.398695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:32.399898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:32.430362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:32.481141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 203/404] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:32.546630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b82d-801c-44aa-acfd-c4e5cc74549b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.584137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.585088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.585605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.586075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/509124be46144611a84fe7272045de87` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.588169 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, group_id=10fbe205353a4a80a36c76924b2fb6d9, role_id=509124be46144611a84fe7272045de87)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:32.589880 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:32.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 202/405] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 30 09:25:32 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:32.790784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:32.791004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:32.868470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:32.944196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b89f1-8695-4da2-b007-e2ffc465a124 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.947705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87867c6-ed39-43d9-9dc5-d85ed19a9213 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:32.984389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:32.985385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:32.985921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:32.986421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:32.997369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:33.002528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:33.003411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:33.004197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:33.006724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 204/406] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:33.015504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.020439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.021067 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.025312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.025312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.047370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:33.052890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:33.053923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:33.054872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:33.062851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 203/407] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:33.066016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.066641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.217456 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace578-325f-449b-b95a-35bceafe67d1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.228248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcfcb6-f3f4-4a93-8b81-d35a9adac3f9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.255232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.257180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.258028 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.258604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.259397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.259921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:33.260393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.262374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.271908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:33.277949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.314819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.315537 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.315817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.316086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.316819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:33.317055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.318467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.337627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 204/409] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:33.343338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.372002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.391547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713beef7-37ac-4191-b009-e013f66047ea None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.434288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.435225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.436403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.437478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] PATH_INFO: `/v3/groups/be9f80ed120b4253a81749fc82acd3cd` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.441641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] RBAC: Authorizing `identity:get_group(group_id=be9f80ed120b4253a81749fc82acd3cd)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.443273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.446544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 206/410] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/groups/be9f80ed120b4253a81749fc82acd3cd => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:33.457953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.563110 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507ad1b-83c5-4f15-b188-ec17bb484725 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.624780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.625757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.626688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.627136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.628469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.630248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.632740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 205/411] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:33.637920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.679394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c068174-1591-4c22-ba5e-b43e24d6a339 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.693751 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.756952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b43b1-17cc-4adc-a415-c89d3ecf62ae None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.796398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.799256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.799733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.800189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.801517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.803172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.805338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 206/412] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:33.806536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.807189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.807466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.807736 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] PATH_INFO: `/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.810445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.811230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] RBAC: Authorizing `identity:get_project(project_id=fb557875fa6e42b4902cd1a1d7e26a4b)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.816228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1bfb9-0121-459c-b1ad-898f86a12b0b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:33.821632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 207/413] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:33 2022] GET /identity/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b => generated 344 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:33.823231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6b65-063f-43f2-8091-ad91843830b4 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.823511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6b65-063f-43f2-8091-ad91843830b4 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.823779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6b65-063f-43f2-8091-ad91843830b4 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.825105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 208/414] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:33.829967 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6b65-063f-43f2-8091-ad91843830b4 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:33.853190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.944085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa85a38-75e9-4b2f-8917-d7236cbe2526 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.959507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6b65-063f-43f2-8091-ad91843830b4 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:33.960505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:33.982952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:33.983438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:33.984270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:33.984541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:33.986775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] RBAC: Authorizing `identity:create_grant(project_id=3b5c6b9e6599482a9a1c1bedac144f85, group_id=10fbe205353a4a80a36c76924b2fb6d9, role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:33.988223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45ab62-d470-41f1-ae1d-b2bff6d679fb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:34.003225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 207/415] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 30 09:25:33 2022] PUT /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85/groups/10fbe205353a4a80a36c76924b2fb6d9/roles/4203118e6def4ea283ce4c49694a4892 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:34.004560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.004840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.005113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:34.007300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.007814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.008408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] PATH_INFO: `/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b/groups/be9f80ed120b4253a81749fc82acd3cd/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.010934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] RBAC: Authorizing `identity:create_grant(project_id=fb557875fa6e42b4902cd1a1d7e26a4b, group_id=be9f80ed120b4253a81749fc82acd3cd, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:34.013413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:34.024923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:34.026265 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:34.029707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 209/416] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 30 09:25:33 2022] PUT /identity/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b/groups/be9f80ed120b4253a81749fc82acd3cd/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:34.114069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 208/417] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:34.409774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:34.493518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:34.520261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1a0e-7576-49e8-b477-8afdf17bb1bf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:34.555418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:34.556411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.556880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.557361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.568905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:34.574530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:34.575478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:34.576281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:34.579395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 210/418] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:34.585306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:34.725318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714257-3e89-4766-9eca-ca673b80d9a5 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:34.727349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:34.772503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:34.773114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.773431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.773754 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.774377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] RBAC: Adding query filter params (name=member) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:34.774680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:34.776108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf82dd5-d156-436a-bd04-edaf7e418675 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:34.795637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 209/419] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:34.806410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:34.829806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdecca-c572-482b-b8b8-b2ef41f79a4d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.830130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdecca-c572-482b-b8b8-b2ef41f79a4d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.830365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdecca-c572-482b-b8b8-b2ef41f79a4d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.831998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 210/420] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:34.836766 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:34.837030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:34.837323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:34.868450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:34.870660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:34.955492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 211/421] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:34.992060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb09d4-9711-436f-9add-908f30d934f9 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.051638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.052260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.052539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.052812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.062304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.148670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:35.150157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:35.244654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.284486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 211/422] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:35.288164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.343665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.398720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.416808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f515-d3ce-4f25-9607-ef9ea3aacaed None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.417691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11045ff0-029f-4285-80db-b257abc00a76 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.456629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.457365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.457771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.458043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.459252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:35.460831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.460957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa7eb7-1a04-4844-b167-857c9b51b63e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:35.461558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.461902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.462254 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.467070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 212/423] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:35.468766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318202-2a2f-4299-a866-87309fef372a None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.469043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318202-2a2f-4299-a866-87309fef372a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.469337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318202-2a2f-4299-a866-87309fef372a None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.473183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:35.474798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 213/424] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:35.475547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9318202-2a2f-4299-a866-87309fef372a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-32b1740a-66d9-469e-8b69-3f8b566f72af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:35.480026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:35.480895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:35.481727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:35.483103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.484099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.484440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.506829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:35.508721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:35.593513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9318202-2a2f-4299-a866-87309fef372a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.601577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.602102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 213/426] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:35.604683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.656953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.657603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.657928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.658255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.659542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:35.661035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:35.664541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 214/427] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:35.671566 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.737103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.755488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e321066-bad7-40b2-ad92-2476d2ea068e None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.795216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.796345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.796628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.796878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.797570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:35.797872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:35.799912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:35.813914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 214/428] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:35.819801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:35.889308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019b231-88eb-4b16-ae31-6ffb83c1dca7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.927652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b3f4-b1c8-4975-b262-3ac67b425f68 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:35.964361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.964965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.965241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:35.965538 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:35.985573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:35.998944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:35.999556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:35.999837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.000111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.000851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=509124be46144611a84fe7272045de87, scope.project.id=7e6f0bf927d041589f84640793ed1e67) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:36.001158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.002619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.021491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 215/429] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=509124be46144611a84fe7272045de87 => generated 611 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:36.022473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.061584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.072467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.145236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb242533-b820-4b11-abd6-ae17e8498a62 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.184947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.186279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.187433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.188044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.200423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:36.207707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:36.208622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:25:36.209445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:36.216861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 216/430] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:36.218649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.320324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 215/431] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:36.322929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.337632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.342564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5722-35e5-49d0-841f-5ee1486e7b57 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.383047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.383047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.383352 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.383439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.384047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:36.384394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.386690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.387437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.402625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 217/432] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:36.402625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.463504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8471-0c8a-4430-93f7-2e9d7c767809 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.507867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.508526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.508803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.509076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] PATH_INFO: `/v3/projects/7e6f0bf927d041589f84640793ed1e67` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.510343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=7e6f0bf927d041589f84640793ed1e67)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.512120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.514199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 216/433] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/projects/7e6f0bf927d041589f84640793ed1e67 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:36.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.529574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c40be-d9ea-4899-b0ff-5dfb4c5767a0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.573696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.574898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.575389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.575857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.609716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.645579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d243-c7a5-4ef3-90a4-74b7f41d1ef6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.660059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.661724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be15215-81bf-44f2-85dc-f395a0891605 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.666480 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.698907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.699808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.700267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.700618 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.701858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.704427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c01223-a9cf-4278-bfa8-2d639876874f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.706226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 217/434] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:36.710512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f22d-0eda-4d16-a249-a4e657ad6b50 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.710945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f22d-0eda-4d16-a249-a4e657ad6b50 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.711288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2f22d-0eda-4d16-a249-a4e657ad6b50 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.712928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 218/435] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:36.717282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2f22d-0eda-4d16-a249-a4e657ad6b50 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.791725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 218/436] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:36.791725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5a44-0cb8-4455-810e-7a380feaeafd None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.791725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5a44-0cb8-4455-810e-7a380feaeafd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.791725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5a44-0cb8-4455-810e-7a380feaeafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.812797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-71ce5a44-0cb8-4455-810e-7a380feaeafd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:36.814030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-71ce5a44-0cb8-4455-810e-7a380feaeafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:36.832828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2f22d-0eda-4d16-a249-a4e657ad6b50 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:36.866720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:36.867304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.867579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.867846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.868555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=7e6f0bf927d041589f84640793ed1e67) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:36.868856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:36.869022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.870402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6ff5d-8142-41dc-9f8d-983d39b454cc None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:36.876403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 219/437] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=7e6f0bf927d041589f84640793ed1e67&role.id=4203118e6def4ea283ce4c49694a4892 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:36.877533 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f85b-90ae-4eb5-bb44-2e48c026f798 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.877812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f85b-90ae-4eb5-bb44-2e48c026f798 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.878080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f85b-90ae-4eb5-bb44-2e48c026f798 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.879260 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 220/438] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:36.879951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719f85b-90ae-4eb5-bb44-2e48c026f798 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:36.883363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 219/439] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:36.884952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:36.885428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:36.885701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:36.903868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:36.905088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:36.934122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:36.988189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 220/440] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:37.008993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719f85b-90ae-4eb5-bb44-2e48c026f798 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.048345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.049004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.049278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.049567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.050724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.052183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.054225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 221/441] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:36 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:37.062555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.168367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825da1f-c01d-4b4a-abde-660e698dc365 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.190863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.193442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.209884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.210515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.210792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.211064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.212182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.213635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.215510 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 221/442] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:37.221128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.330612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de994f-b376-40d2-a7c8-d04515907299 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.345046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ee76-df3d-4c04-9c2c-2bfd972e57b3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.345492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.367438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.368062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.368340 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.368646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.378386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:37.379255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.379839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.380113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.380384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.381105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=509124be46144611a84fe7272045de87, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:37.381439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.382855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:37.383608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:37.384635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:37.385585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 222/443] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:37.386222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.391712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 222/444] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=509124be46144611a84fe7272045de87 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:37.394137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.468913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.505212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbde00-874a-425d-b2b8-2bbf19dc016f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.527313 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c1a2f-8817-4985-ad74-8392959096ab None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.543452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.544187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.544469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.544736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.557373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:37.563965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:37.564847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:37.565683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:37.566276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.566678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 223/445] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:37.566747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.566747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.566747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.566943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:37.567098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.568468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.572224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.578329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 223/446] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:37.583889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.611906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.692992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dd6d-a66b-46af-b1d3-2485a3098269 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.698840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fac8-1de4-4f05-ac7d-0f31da0d901e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.711466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.734332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.734858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.735131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.735297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.735470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.736052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:37.736195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.736333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.736498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.737718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.746974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 224/447] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:37.753849 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.808817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.810287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:37.851123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.857345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9339-4c4e-46e2-8993-fc11b9e517e5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:37.890688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:37.891277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:37.891550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:37.891819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:37.907544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 224/448] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:25:37.913104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:37.927458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:37.959202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:37.960679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.011248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baef89-35cc-43d3-98f5-dbdb0b0002aa None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.043829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59782386-66c5-4420-add9-87b433285d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.044463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59782386-66c5-4420-add9-87b433285d18 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.044737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59782386-66c5-4420-add9-87b433285d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.045004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59782386-66c5-4420-add9-87b433285d18 None admin] PATH_INFO: `/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.046673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59782386-66c5-4420-add9-87b433285d18 None admin] RBAC: Authorizing `identity:get_project(project_id=fb557875fa6e42b4902cd1a1d7e26a4b)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.048133 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59782386-66c5-4420-add9-87b433285d18 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.049904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:38.050098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 225/449] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/projects/fb557875fa6e42b4902cd1a1d7e26a4b => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:38.055324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59782386-66c5-4420-add9-87b433285d18 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:38.059468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 225/450] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:25:38.064833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:38.135063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:38.154342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59782386-66c5-4420-add9-87b433285d18 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.160463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f1fd-1b8d-4e19-ac04-d5256c33404b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.188378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.188982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.189267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.189550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] PATH_INFO: `/v3/groups/be9f80ed120b4253a81749fc82acd3cd` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.190649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] RBAC: Authorizing `identity:get_group(group_id=be9f80ed120b4253a81749fc82acd3cd)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.192075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.193210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.193651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 226/451] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:38 2022] GET /identity/v3/groups/be9f80ed120b4253a81749fc82acd3cd => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:38.193913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.194193 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.194459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] PATH_INFO: `/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.195617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] RBAC: Authorizing `identity:get_project(project_id=3b5c6b9e6599482a9a1c1bedac144f85)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.197032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.198830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 226/452] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:25:38 2022] GET /identity/v3/projects/3b5c6b9e6599482a9a1c1bedac144f85 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:38.199587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:38.203929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:38.263316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:38.297886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1cbcd-cda6-435b-8a9e-d99990382896 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.299893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2a76-e109-433a-a747-779e63b56c59 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.332478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.332830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.333178 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.333441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.333534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.333719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.333822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] PATH_INFO: `/v3/groups/10fbe205353a4a80a36c76924b2fb6d9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.333991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.334711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] RBAC: Adding query filter params (group.id=be9f80ed120b4253a81749fc82acd3cd, role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=fb557875fa6e42b4902cd1a1d7e26a4b) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:38.334797 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] RBAC: Authorizing `identity:get_group(group_id=10fbe205353a4a80a36c76924b2fb6d9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.335016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.336228 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.336431 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd4d8b-635d-4579-9a22-88e13bae32ba None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.337792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 227/453] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 30 09:25:38 2022] GET /identity/v3/groups/10fbe205353a4a80a36c76924b2fb6d9 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:38.342157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 227/454] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:38 2022] GET /identity/v3/role_assignments?group.id=be9f80ed120b4253a81749fc82acd3cd&scope.project.id=fb557875fa6e42b4902cd1a1d7e26a4b&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:38.343660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:38.450748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110273f3-7d4e-4aee-a6ff-39bd9cc031c0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:38.480516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:38.486314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:38.486928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:38.487202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:38.487468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:38.488211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] RBAC: Adding query filter params (group.id=10fbe205353a4a80a36c76924b2fb6d9, role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:38.488518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:38.490029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f655-2258-4a00-bbdc-d2d9cf64eb34 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:38.496511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 228/455] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 30 09:25:38 2022] GET /identity/v3/role_assignments?group.id=10fbe205353a4a80a36c76924b2fb6d9&scope.project.id=3b5c6b9e6599482a9a1c1bedac144f85&role.id=4203118e6def4ea283ce4c49694a4892 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:41.163881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e04-edd3-488a-8dde-44b32b10a249 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.164943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e04-edd3-488a-8dde-44b32b10a249 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.165462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e04-edd3-488a-8dde-44b32b10a249 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.167246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 228/456] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:41.178703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d5c6-ded6-4fe1-a6b0-c0c10b28e76e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d5c6-ded6-4fe1-a6b0-c0c10b28e76e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.179996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d5c6-ded6-4fe1-a6b0-c0c10b28e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.206219 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-efe4d5c6-ded6-4fe1-a6b0-c0c10b28e76e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:41.207808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-efe4d5c6-ded6-4fe1-a6b0-c0c10b28e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:41.301571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 229/457] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:41.355154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-33a3-4495-89c1-755e540b04f3 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.355763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-33a3-4495-89c1-755e540b04f3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.356229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-33a3-4495-89c1-755e540b04f3 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.357809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 229/458] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:41.363675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67537e4-5de2-4373-ac4d-a3101941c992 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.364197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67537e4-5de2-4373-ac4d-a3101941c992 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.364664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67537e4-5de2-4373-ac4d-a3101941c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.384742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b67537e4-5de2-4373-ac4d-a3101941c992 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:41.385946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b67537e4-5de2-4373-ac4d-a3101941c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:41.479879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 230/459] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:41.681842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0d36-33a3-4495-89c1-755e540b04f3 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:41.698752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:41.801934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f458-a20e-4535-b9de-d198bb47985a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.802618 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f458-a20e-4535-b9de-d198bb47985a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.803190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f458-a20e-4535-b9de-d198bb47985a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.804707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 231/460] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:41.809759 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.810279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.810781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.810949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0d36-33a3-4495-89c1-755e540b04f3 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:41.849763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:41.851794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:41.852375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:41.853076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:41.853391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:41.853668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:41.867702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:41.869188 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:41.889925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:41.890915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:41.891774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:41.891774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:41.891774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:41.891774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 230/461] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:41.892124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:41.912590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:41.931356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 232/462] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:41.932566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:41.963111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.018582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a25eb-1866-4308-83ab-cb6527b494da None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.067139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.068078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.068494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.070364 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710cb2c-f085-42bf-af1c-a42af706da9b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.083031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.084744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-52589375-2362-4b4d-a5ef-eb22b646126b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:42.103571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:42.104572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:42.105445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:42.105445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.105445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:42.106129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 231/463] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:42.107260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5416e-6628-4410-bde5-725280f8713a None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.107535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5416e-6628-4410-bde5-725280f8713a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.107805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5416e-6628-4410-bde5-725280f8713a None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.109226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 232/464] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:42.110645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5416e-6628-4410-bde5-725280f8713a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.118886 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.119682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.120097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.120529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.121372 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:42.122105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.125110 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97746-c1cf-439c-9c25-13a3601307ad None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.147836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 233/465] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:42.149840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.150327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.150808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.168554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:42.170001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:42.215809 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.236074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5416e-6628-4410-bde5-725280f8713a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.243102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 234/466] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:42.243818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.263182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.287051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.288393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.289122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.289822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.290968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:42.291910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.294203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.310734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 233/467] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:42.312788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.346020 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da60b-7056-4396-9b2c-f2eadc54ccde None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.381042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.381799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.382142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.382498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.383220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.384760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.422490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 235/468] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:42 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:42.423245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.451116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11404-baf7-411c-b293-2b1e1ea3219a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.481804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.497897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.499499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.500033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.500499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.512993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.515708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:42.535728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:42.536677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:42.537576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:42.537576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.537576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:42.539512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 234/469] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:42.547923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.575650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07395e-d835-4f5a-a6cf-c883b7f9bf34 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.590139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.617542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.618351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.618626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.619273 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.620752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.646483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 236/470] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:42 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:42.647467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.721065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4aa8-f97f-4f7d-9add-de9cc39620e2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.755164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.773829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca808b7-374a-4fb1-bddf-06e6678bb67a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.782154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.783027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.783511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.784577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.800799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.803204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:42.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:42.824147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:42.825197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:42.825197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:42.825197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:42.825526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:42.826281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:42.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:42.827077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:42.827712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 235/471] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:42.831264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:42.831264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:42.831264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:42.835370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.847611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 237/472] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:42.854572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:42.977776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:42.981495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94130fd-9189-4a41-9368-77425269de5a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:42.994064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f8a0-c311-4fde-a6c3-d4bfba6a91c2 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:43.025516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:43.026681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.027099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.027506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.028969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:43.029447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:43.031995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:43.042844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:43.043591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.043968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.044332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.046333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:43.047248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b5a75-8228-42a7-a96e-d81e1321afd7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:43.051060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 236/473] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:43.056759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:43.083966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 238/474] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:42 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:25:43.085563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a897-7a04-4ae2-88ce-27b4e2500f6d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.085872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a897-7a04-4ae2-88ce-27b4e2500f6d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.086142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a897-7a04-4ae2-88ce-27b4e2500f6d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.087574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 239/475] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:43.093099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.093500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.093721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.103553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:43.122681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:43.124729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:43.215503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8dd7-32df-46b1-9581-a94e355ba40c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:43.221337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 240/476] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:43.279320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:43.280011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.280233 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.280431 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.281090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:43.282540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:43.303667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:43.313719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 237/477] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:43 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:25:43.533077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:43.644820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808a58-ebb2-4f5c-9451-931303603239 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:43.684488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:43.685142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.685447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.685718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.686920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:43.688286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:43.692259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:43.697456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.sql.core [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:25:43.697456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:25:43.697456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [parameters: {'id': '10d58a0306734c1da39ac887a6b7d8b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:25:43.697456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81493) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result.read() Sep 30 09:25:43.716158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return ref.to_dict() Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:25:43.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application yield resource Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise self.value Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application session.commit() Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:25:43.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:25:43.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:25:43.720267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result.read() Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:25:43.721069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [parameters: {'id': '10d58a0306734c1da39ac887a6b7d8b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:43.722147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:25:43.723112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:43.724607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 241/478] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 30 09:25:43 2022] POST /identity/v3/roles => generated 144 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:43.730487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:43.846846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8ee8-cf19-44f1-af03-4756a892ad86 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:43.882866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:43.883491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:43.883765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:43.884032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:43.895320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-5a55e053-03fa-43c0-91c9-0b56c9cf1128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:43.900528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:43.901434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:43.902228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 238/479] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:25:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:43.913988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:44.046614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e6fb-45e3-42b2-b19b-990d7144e07e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:44.087966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:44.088563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:44.088836 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:44.089109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:44.089792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:44.090089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:44.091452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc915-757c-4468-9c90-b37387c27ca7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:44.104356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 242/480] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:45.050427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152b21-7964-46b6-b2cb-666ab258eba6 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.050942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152b21-7964-46b6-b2cb-666ab258eba6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.050942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152b21-7964-46b6-b2cb-666ab258eba6 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.052582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 239/481] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:45.057709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619fff3-468a-4933-9850-e397d60d1f41 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.058098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619fff3-468a-4933-9850-e397d60d1f41 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.058256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619fff3-468a-4933-9850-e397d60d1f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.082310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-f619fff3-468a-4933-9850-e397d60d1f41 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:45.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f619fff3-468a-4933-9850-e397d60d1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:45.158474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:45.175460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 243/482] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:45.527348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77152b21-7964-46b6-b2cb-666ab258eba6 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:45.532458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b98f-0765-43ae-83c5-8375f525e0f8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.532786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b98f-0765-43ae-83c5-8375f525e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.533010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8b98f-0765-43ae-83c5-8375f525e0f8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.534651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 244/483] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:25:45.539867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.540250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.540531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.559109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:45.560270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:45.606565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:45.663127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77152b21-7964-46b6-b2cb-666ab258eba6 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:45.672292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 245/484] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:45.710010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:45.710641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.710917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.711193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.727055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:45.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:45.733709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:45.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 240/485] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:45.742316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:45.887807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9028-e5c9-4c55-8915-00e5498c8ec4 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:45.918688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:45.944320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:45.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:45.945198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:45.945492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:45.946164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:45.946459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:45.947831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:45.958239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 246/486] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:45.963888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.073843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.104790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7750-3cfc-4257-9beb-feb8fd3a2795 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.125463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.145911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.146684 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.147035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.147556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.160634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.162286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-72ec1ff9-f2b3-463b-ad01-8076b765b742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:46.178672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:46.180700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:46.182733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:46.182733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:46.182733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:46.186310 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 241/487] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:46.189112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9ef0-9dc9-4efd-a75f-ce2fc0939f41 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.189540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9ef0-9dc9-4efd-a75f-ce2fc0939f41 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.189820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9ef0-9dc9-4efd-a75f-ce2fc0939f41 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.191721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 242/488] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:46.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9ef0-9dc9-4efd-a75f-ce2fc0939f41 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.205737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7406-5a63-49f4-8835-42fce86889eb None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.249870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.250505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.250791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.251071 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.262112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-e3538425-58e0-40ca-b8a2-c327832901a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:46.267850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:46.270004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 247/489] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:46.271872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.273652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.273652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.297217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:46.299032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:46.324831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9ef0-9dc9-4efd-a75f-ce2fc0939f41 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.345377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.362480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.363612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.364091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.364587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.365536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:46.366420 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.368307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f200bcf-cf3b-47ef-a5ca-964c81c6bf46 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.380458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 248/490] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:46.381174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.388724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 243/491] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:46.390757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9ec87-52e5-485c-a2b4-57c10c06723d None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.391227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9ec87-52e5-485c-a2b4-57c10c06723d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.392181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9ec87-52e5-485c-a2b4-57c10c06723d None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.398460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 244/492] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:46.399443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9ec87-52e5-485c-a2b4-57c10c06723d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.445780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.502349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ef9b0-47ed-4a1e-a25b-2c76817ac342 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.527669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9ec87-52e5-485c-a2b4-57c10c06723d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.540868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.541546 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.541881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.542199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.543027 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:46.543562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.545151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d524c5-9f8f-4d60-9c85-6b1d56d9e460 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.554904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 249/493] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:46.556511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.556984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.557434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.567989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866238-7413-4708-8957-130c7cc27895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.568736 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866238-7413-4708-8957-130c7cc27895 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.569116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866238-7413-4708-8957-130c7cc27895 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.569518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866238-7413-4708-8957-130c7cc27895 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.577782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866238-7413-4708-8957-130c7cc27895 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.579504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866238-7413-4708-8957-130c7cc27895 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.580140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:46.581806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-17866238-7413-4708-8957-130c7cc27895 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:46.593596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:46.594955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:46.596152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:46.602214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 245/494] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:46.603145 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866238-7413-4708-8957-130c7cc27895 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.620125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.674616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:46.675717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.705525 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.718849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866238-7413-4708-8957-130c7cc27895 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.759180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.759987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.760341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.760710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.774877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.776458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:46.792788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:46.793926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:46.794982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:46.794982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:46.794982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:46.796335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 246/496] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:46.797323 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.800317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f84773-c9b3-4d3c-9675-d0b2cccd972e None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.847086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.848205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.848626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.849093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.850736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:46.851189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:46.853302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:46.905292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 251/497] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:46.906319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.915893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d440eb-46f2-4835-876d-96b18a7e68f2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:46.940974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:46.961931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:46.962466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:46.962738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:46.963001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:46.975183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:46.980413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:46.981490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:46.982421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 247/498] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:46.986357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:46.989505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.028067 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf7de-041c-4ca3-be3d-445b677ad287 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.062850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.063448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.063725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.063996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.064635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:47.064934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.066353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.077821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 252/499] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:47.078732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.089009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3453e-5d74-4ebd-bbb6-153228f69d42 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.121770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.122397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.122628 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.122898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.158571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.176351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976ce7-9dbe-42a1-82a9-797a62866549 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.189186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.190662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aaf6b-b72d-44b1-b9e0-c7331d3692f2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.192395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.209472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.210090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.210367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.210642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.220368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:47.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:47.226511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 253/500] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:47.230468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.287164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 248/501] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:47.288386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b791d5-295c-4e53-a8df-7ce48609eeba None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.288665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b791d5-295c-4e53-a8df-7ce48609eeba None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.288934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b791d5-295c-4e53-a8df-7ce48609eeba None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.290334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 249/502] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:47.290845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b791d5-295c-4e53-a8df-7ce48609eeba None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.331461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814ab4-89bb-4bd9-aca2-118f29bb50e7 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.363800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.364393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.364664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.364929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.365678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:47.365973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.367345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.375026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 254/503] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:47.375827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.378960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.395933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b791d5-295c-4e53-a8df-7ce48609eeba None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.397441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.433343 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.434049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.434402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.434675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.441702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.443148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:47.454606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:47.455582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 250/504] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:47.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.481015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5ddf-27ac-404f-baf8-89c9dbbb4051 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.513300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.513919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.514195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.514465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.515121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:47.515417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.516773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f70c-8bbd-494e-9336-7f332807f4b5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.524181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 255/505] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:47.525374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.525655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.525924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.543468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:47.544650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:47.553837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0407d-14ab-40d0-af90-b4bb4b2fee18 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.585879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.586483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.586754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.587019 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.597054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.598514 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.602549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.610648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 256/506] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:47.611437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:47.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:47.614856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:47.615711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:47.615711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.615711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:47.616280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 251/507] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:47.618087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.640710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.718963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e369-eb5d-4b30-8285-7906ff2b85e3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.732152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f70ad-4b8d-4e29-b16f-bc41201cead4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.754885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.755511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.755786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.756055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.766811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.768326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.768447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.768913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.769186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.769483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.770204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:47.770504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.771904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:47.784190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:47.785122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:47.786318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:47.786318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.786318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:47.789901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 257/508] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:47.790552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.808724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 252/509] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:47.809427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.848983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.884504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:47.901959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4527-ed1e-4bdd-affb-7dfcf356a91c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.916590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621132-37d1-45c2-9f14-428c8be16fef None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:47.937451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.938113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.938419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.938733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.949131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.950687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.951111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:47.951721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:47.951994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:47.952264 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:47.952898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:47.953199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:47.954571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:47.970197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 253/510] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:47.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:47.971417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:47.972266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:47.972266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:47.972266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:47.972437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:47.972504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 258/511] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:47.972504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.071017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.071204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84a3-1656-411d-9784-9bcce48c7cb3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.074154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecba445-d4bb-4970-8215-965b3e368fc2 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.101491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.107066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.108254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.108471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.108952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.108952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.109117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.109369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.109500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:48.109643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.109830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.111343 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.128094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 254/512] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:48.128094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.176173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.177651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.226125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfd38e-0f96-432e-8a96-07a125ab680e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.258830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.259430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.259703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.259968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.269850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.270605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.271279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.274632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 259/513] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:48.275665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:48.286955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:48.287927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:48.288757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:48.288757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:48.288757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:48.288757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 255/514] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:48.288987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.335807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.376032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a6a7-7e5a-4797-94ae-b7778de8a9de None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.390727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2d731-227e-4c94-8f12-44564184a294 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.412256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.413100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.413417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.413691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.420369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.421859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.424354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.424953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.425231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.425547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.426193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:48.426495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.427850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:48.434045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:48.434867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:48.435785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 260/515] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:48.436248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.443239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 256/516] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:48.443908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.498913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.539682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3328268-6974-457e-8076-c4be19c9eb0e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.542465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1dcb6-6edd-40fb-9d58-72fe57b939a4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.572831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.573104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.573405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.576277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.577427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.577704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.577974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.581151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.582623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.587852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.589226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:48.595621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:48.596568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 261/517] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:48.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:48.606792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:48.607830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:48.608716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:48.608716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:48.608716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:48.608716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 257/518] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:48.608716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.696870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931c3a1-0f4a-485c-a6b5-a9cf9ffb11cd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.709176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd084c6-c595-45d5-84ae-ebb018164f14 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.716590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.731527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.732123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.732401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.732734 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.733909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:48.734210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.735595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.746922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 262/519] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:48.747703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.763000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.763643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.763987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.764266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.765052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:48.765411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.766953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.785244 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 258/520] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:48.786143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.803492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:48.847947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05ff0-749c-468a-8d75-9351efedb37e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.880829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.881480 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.881653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0004-43dd-4e45-a3ae-0a86c451c6d5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:48.881765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.882021 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.889712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.891148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:48.902344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:48.903213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:48.904084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 263/521] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:48.905168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.919449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:48.920080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:48.920403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:48.920677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:48.921587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:48.921924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:48.923639 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:48.941221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 259/522] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:48.942012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:48.948318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.005914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdf98-d7f9-4a23-83a9-a44a554e8568 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.017992 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.040893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.041544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.041819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.042085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.042719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:49.043015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.043876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cea97-87e0-467a-8bb4-d2237fc7e5c2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.044382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.056263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 264/523] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:49.057073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.082234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.082821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.083094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.083359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.083997 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.085442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.107120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 260/524] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:48 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:49.108463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.174848 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.178255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8b93-7841-4495-8e45-659e8d77d4bc None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.219502 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.220117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.220524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.220801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.221648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:49.221922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.223388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.224307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51a41e-eafe-4c9a-b714-ddcda1399d71 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.241585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 265/525] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:49.241585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.269109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.280907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.283605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.283605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.283605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.283871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:49.284090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.285610 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.312231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 261/526] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:49.313117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.394422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6054a-3d1f-4d90-8c2b-65ce9a144705 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.443933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.444443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.444720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.444991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.459962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323db3-4005-457e-a1cc-faaa4757a9cb None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.477928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.505082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.506040 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.506353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.506775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.516348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.517730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.517920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.519188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:49.537737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:49.538727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:49.540043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 262/527] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:49.540513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.613356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.642697 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 266/528] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:49.643529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.693136 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88cf83-416b-47f3-8466-a065589aba55 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.710933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.741649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.742195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.742477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.742750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.755761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c245231-2db5-425c-815e-c7d158dbd256 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.791636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.792300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.792586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.792859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.793769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:49.794073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.796319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.820050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 267/529] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:49.821280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.824460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.827257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.876936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190ece-85b2-4deb-b883-a94ec216b7c4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.943457 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 263/530] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:49.944416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.970725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.984611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.985905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.986329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.987013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.000342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.002572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:50.028479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:50.030101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:50.030985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:50.030985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:50.030985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:50.031149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 268/531] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:50.037035 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.087718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feb594-2e37-466b-abe6-ee061132a8a5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.127303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.128359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.128948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.129450 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.130393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=7fa68549998f496ca54350b3bcec0bef) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:50.130896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.132718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.145757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 264/532] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/role_assignments?user.id=7fa68549998f496ca54350b3bcec0bef&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:50.147118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.149152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d71c8-6def-4889-a685-be6b4c89ca60 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.177551 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.199918 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.200563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.200752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.201024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.229083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.230657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:50.262378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:50.263343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:50.264270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:50.264270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:50.264270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:50.264270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 269/533] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:50.269600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.312950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.364920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a821458-d80a-4dd8-83bd-4e0b48363a39 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.430375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1720d-aa9a-4f41-a4b1-0bad13cef759 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.430563 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.431156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.431439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.431713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.432371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:50.432672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.434087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.460536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 265/534] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:50.470665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.477136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.478057 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.478534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.479036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.480080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:50.480595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.482220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.497004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 270/535] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:50.503363 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.638258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.673782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.686350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669c50-0d98-482f-b7ab-c7a439675e3b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.707997 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24b25-9863-49cc-bbc2-0f20a21215d3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.731711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.732261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.733071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.733367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.753525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.754432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.754927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.755390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.757579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.759043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.763040 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.764750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:50.776355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:50.777171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:50.778115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:50.780475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 271/536] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:50.789140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:50.790084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:50.790920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 266/537] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:50.792680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.792894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.893554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d4-8f6f-4dfa-b506-3fe6585283d2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.925888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.928708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.929355 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.929642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.929916 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.930620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:50.930928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.932367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.949570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 267/538] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:50.951343 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.996370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f9f-0e56-4d37-8832-fc6bbe65dc4a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:51.059361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:51.059983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.060261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.061065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.061799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:51.062102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:51.063547 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:51.068251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc51cc-dd47-4b69-a620-9404cfba4b22 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:51.093645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 272/539] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:51.094576 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:51.104258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:51.104852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.105131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.105463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.106192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=6d02936fe7de42d7a441bdb0e0d60fc8) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:51.106504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:51.108035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b8979-a1ec-46e1-9e90-b0b5aba70e17 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:51.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 268/540] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:50 2022] GET /identity/v3/role_assignments?user.id=6d02936fe7de42d7a441bdb0e0d60fc8&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:51.122897 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:51.229853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4c8-93f8-4fc5-95ad-db3911a41705 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:51.274264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:51.274833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.275116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.275395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.276245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=50516a9eb95f42129b257c5b71b782a8) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:51.276586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:51.278207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560cf7-56c4-41b6-a492-10a705cd3832 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:51.285883 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 273/541] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:51 2022] GET /identity/v3/role_assignments?user.id=50516a9eb95f42129b257c5b71b782a8&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:51.570570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1eff-a571-4786-ba22-c3b2615b8263 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.571104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1eff-a571-4786-ba22-c3b2615b8263 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.571104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1eff-a571-4786-ba22-c3b2615b8263 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.572588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 269/542] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:51.578384 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762000-3ccc-475c-8adc-897945b3a640 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.578892 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762000-3ccc-475c-8adc-897945b3a640 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.579352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762000-3ccc-475c-8adc-897945b3a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.606316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-a1762000-3ccc-475c-8adc-897945b3a640 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:51.608048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-a1762000-3ccc-475c-8adc-897945b3a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:51.707722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 274/543] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:51.766487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cd6e7-45e9-431e-aac1-b693b0663b73 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.766790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cd6e7-45e9-431e-aac1-b693b0663b73 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.767035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cd6e7-45e9-431e-aac1-b693b0663b73 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.768622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 270/544] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:51.773716 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:51.774006 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:51.774301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:51.781220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:51.794544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:51.796293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:51.864389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 275/545] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:52.209858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cd6e7-45e9-431e-aac1-b693b0663b73 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.240867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.288284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:52.347049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cd6e7-45e9-431e-aac1-b693b0663b73 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:52.354682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395362d7-a7fa-4c69-bcfb-23e25051f813 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:52.381953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:52.382582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.382858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.383131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.402170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:52.403004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:52.409217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:52.410089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:52.410906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 271/546] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:52.418208 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.425999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:52.426641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.426920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.427193 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.438357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:52.443159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:52.444026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:52.444799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 276/547] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:52.450015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.624897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98405b2-1bed-4b8b-8256-b3dd489ed3d4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:52.646543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0da3b9-c639-4e73-8bd6-bc87fcf61d65 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:52.663775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:52.687963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:52.688851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.689132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.689430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.690098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:52.690402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:52.691791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c6b0-0aeb-4a60-a228-428efa2806d5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:52.701089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 272/548] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:52.702357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c82c6-80a2-498b-878e-6b838ec84db5 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.702652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c82c6-80a2-498b-878e-6b838ec84db5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.703006 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c82c6-80a2-498b-878e-6b838ec84db5 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.707791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:52.708453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.708721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 273/549] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:52.708993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.709286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.709967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:52.710268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:52.710374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.710702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.711065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.711640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:52.722838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 277/550] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:52.723726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.738252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:52.739802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:52.793550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:52.825577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 274/551] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:25:52.826964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:52.865741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8900-1557-4975-bc80-dcf9ee6d058d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:52.927303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:52.927856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.928134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.928402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.954397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:52.955922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:52.975063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:52.977292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:52.979292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:52.979292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:52.979292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:52.985080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 278/552] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:52.996257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.009555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f88e-3664-4ad5-87ed-de5ebfe85ed0 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.032468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.082927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.083560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.083834 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.084110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.108660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.111030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:53.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:53.143705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:53.143705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:53.143705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:53.144296 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 275/553] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.150988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.184266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1abd-5c30-4543-a2d2-9c7b1af32a59 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.193284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.224561 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.225402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.225883 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.226227 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.226945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.227405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.229100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.242479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 279/554] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:53.243367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.297610 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a17f64-db5f-45f9-8105-f735f2865e0c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.342493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.343275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.343576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.343977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.344797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.345133 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.346524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.353951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319ffb-4d2d-4148-a48f-b411570f4550 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.365347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 276/555] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.366223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.394282 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.395573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.396251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.396558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.396909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.416473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:53.422681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.423649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:53.424461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:53.431279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 280/556] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.432317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.473704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.492816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02094-052c-4ab3-8b12-6c7cf8b7a9b5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.532843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.534519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.534979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.535434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.544575 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.546315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:53.560275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.562554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:25:53.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:53.566908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 277/557] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.567995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.580531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7812-a16c-4082-98f9-bd07f7561bdc None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.630246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.630997 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.631495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.631873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.643459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.645200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:53.657153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.658143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:53.659170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:53.661735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 281/558] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.662732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.678189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.703678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7997-eaa5-4f6a-a850-6f061da0705b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.740657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.741174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.741479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.741748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.742408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.742707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.756738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 278/559] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.756738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.758908 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.777978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab17eb-fcb2-44ce-b599-5619d9b2cb84 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.817042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.817738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.818055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.818349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.819147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.819493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.820966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530bc64-c276-4b7f-872e-f2687e1047d9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.839987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 282/560] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.845934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9c2f-c685-4f3d-91d0-d2e491564045 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.846259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9c2f-c685-4f3d-91d0-d2e491564045 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.846569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9c2f-c685-4f3d-91d0-d2e491564045 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.848179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 283/561] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:53.848946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d9c2f-c685-4f3d-91d0-d2e491564045 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.867943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f8d2-7590-4443-98c4-73ce97823133 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.905395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.906053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.906366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.906661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.907414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.907742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.909234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.923382 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.927390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 279/562] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.930242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.960068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d9c2f-c685-4f3d-91d0-d2e491564045 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.993621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.994177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.994455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.994728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.005685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.007309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.009988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ee53f5d8-079c-4429-8adc-9e02ab1a5335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:54.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.024192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:54.025329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:54.025329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.025329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:54.028736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 284/563] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.030412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61023afd-99e3-4d88-9f7e-40eb948de935 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.030701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61023afd-99e3-4d88-9f7e-40eb948de935 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.030973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61023afd-99e3-4d88-9f7e-40eb948de935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.032468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8933-1489-47c6-912b-752063d0da9c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.049208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-61023afd-99e3-4d88-9f7e-40eb948de935 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:54.050417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-61023afd-99e3-4d88-9f7e-40eb948de935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:54.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.068123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.068668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.115778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 285/564] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:54.117100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2578-90b1-4e0f-b91b-55b3c6e7ad76 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.117614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2578-90b1-4e0f-b91b-55b3c6e7ad76 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.117737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2578-90b1-4e0f-b91b-55b3c6e7ad76 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.119042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 286/565] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:54.119575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb2578-90b1-4e0f-b91b-55b3c6e7ad76 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.140291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.142970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.145191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.230103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb2578-90b1-4e0f-b91b-55b3c6e7ad76 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.249909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 280/566] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:54.250680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.259117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.268978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.269625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.269903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.270167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.280833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.282286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3512b1f1-16bd-4afe-8b8f-fb2dd4425835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.297745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:54.298640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:54.298640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.298640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:54.302390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 287/567] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.303590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.303872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.304144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.325081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:54.327114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:54.363242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.366094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6189ff-7248-4d4e-86c7-606bc48f2477 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.400617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.401455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.401904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.402022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 288/568] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:54.402403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.402862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.403367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:54.403791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.405364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.417160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 281/569] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:54.417900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.519540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803786-0ac1-4713-9829-0d390f520d22 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.525061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba2f8-41ba-4bdb-9797-2a2a9b2413a3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.530629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.557431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.558293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.558572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.558844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.562328 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.562921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.563202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.563475 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.564117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:54.564434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.565929 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.569346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.570767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.583796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 282/570] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:54.583796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:54.589506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.590447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:54.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:54.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:54.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 289/571] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.591534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.606232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.694702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2af2a4-d793-40b9-a467-3d57d4dc87c6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.699000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019eaa-3c1e-40b6-8f22-96151170e21a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.728119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.728730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.729005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.729302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.731480 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.732097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.732915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.733185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.739564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:54.740376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.741845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:54.744225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.745388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 283/572] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.746607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:54.758719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 290/573] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.760575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.782519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.830711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.850178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fab0-5bc6-4e25-8f26-2993ad2f74fe None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.859776 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59bc81-6c34-4da9-bb71-33ddcc296030 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.883542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.884160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.884435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.884711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.891435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.892226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.892823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.892918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.893100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.893406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.894039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:54.894339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.895734 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:54.903838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.905549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:54.906440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 284/574] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.906916 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.915914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 291/575] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:54.915914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.990878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.003675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3eb85-95d0-4319-83d1-2058bae913c0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.010168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a6bc-04eb-4f68-9d76-d9f987cc0b62 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.037301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.037862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.038139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.038416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.044596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.045819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.046096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.046366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.046499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.047339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.047634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.049036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.049912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:55.054637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.055611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:55.056432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 285/576] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.057121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.061302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 292/577] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.061302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.158554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6ef1-41ed-42fe-9924-ed7a40ddf622 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.158800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624877c-e865-46b0-9912-1801c5d14475 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.191682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.192272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.192545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.192806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.192938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.193435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.193531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.193715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.193821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.193986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.194706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.195006 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.195237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.196428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.206703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 293/578] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.207474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.209884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.215558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 286/579] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.216364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.274628 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.309541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b5342-f786-4851-94b3-5bf9398befd3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.316152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e2c3-fec2-43e3-852e-50ec9ec422c3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.342868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.343490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.343767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.344047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.348416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.349003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.349301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.349572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.350231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.350532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.350621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.351876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.351977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.359993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 287/580] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.360759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:55.363389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.364471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 294/581] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.365382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.425820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.464318 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687538eb-5faf-4b27-8da5-59847cf83859 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.468089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935127ca-7e21-482f-8313-c7e7d4ae5833 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.488061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.499382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.500038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.500314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.500586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.502600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.503216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.503491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.503768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.514748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.515258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=1ae0aa2cf16f420db7bcb87d4d995901, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.516175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.516677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.528360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 295/582] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:55 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:55.529225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:55.530358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.531309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:55.532213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:55.532213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.532213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:55.532213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 288/583] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.532514 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.650252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a525d9d-b722-40ea-9d1a-56f16ed73875 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.656540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507432-958f-4bda-ba82-627819f39f74 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.673375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.688555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.689197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.689503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.689775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.697611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.698250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.698528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.698799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.703174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.704630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.712527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.714723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:55.723365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.724316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:55.725202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:55.725202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.725202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:55.725202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 289/584] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.727347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:55.732182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.733755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:55.734635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:55.734635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:55.734635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:55.734635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 296/585] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.735244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.757789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.835587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c475-6380-4521-86f6-bf53a3bbcfe7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.841423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7905a-4c30-467a-a2bf-6bf83f6e6f07 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.871578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.872178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.872455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.872727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.874044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.874347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.875770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.876344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.876953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.877229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.877526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.878159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.878465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.879817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.893571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 290/586] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.893571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.898212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 297/587] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:55.899298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.928579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.986817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.004485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10f3a-9ae6-433d-898e-632e031c2140 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.011323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097015-f6f6-4cce-94f7-34269b0cbc48 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.041229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.041983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.042263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.042540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.043185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.043488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.045895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.050358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.050956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.051230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.051494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.052177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.052760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.053854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.062760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 291/588] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.062760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.066696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 298/589] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.066696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.155171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.168644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca994df-3d6b-4efb-9531-cb783901fda2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.172007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5dc73-94f9-4448-80d8-b76002950adc None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.204316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.204879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.205156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.205449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.206165 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=bf7c613ffbc6445296b63c1083ac8357) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.206466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.206640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.207272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.207554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.207826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.207917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.214181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 292/590] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/role_assignments?user.id=bf7c613ffbc6445296b63c1083ac8357&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.215575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.217591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.221169 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:56.230939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:56.231962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:25:56.233571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:56.237654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 299/591] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:56.238645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.239189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.353224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0e6c-a3b3-4d03-a9fe-e0ee4754dffb None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.376230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7112c-cc68-4288-b223-02d6e1c242f6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.395717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.396415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.396624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.398091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.405884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.407890 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:56.421075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:56.422330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:25:56.423578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:56.427080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 293/592] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:56.428066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.429234 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.430162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.430605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.431384 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.441433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.443513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:56.459888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:56.460758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:56.461680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:56.469222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 300/593] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:56.469222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.474320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.505140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.541670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acf417-e385-42ab-87d2-7e5fd6f517a0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.576587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.577183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.577498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.577764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.578489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.580193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.597861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 294/594] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.598470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.620793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028da92-0ba9-4d7d-8c56-4cce73a2db62 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.666687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.668224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.668966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.669526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.671262 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.672624 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.674299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.698560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.699967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.707380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5816-1fdd-4957-9282-de66616952c1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.735464 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.751442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.752054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.752324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.752591 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.753312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:56.753617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.755050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.769464 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 295/596] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:56.770424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.779194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:56.821388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e230c6-dc81-4878-9e2d-6480eef32824 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.855748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.856477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.856816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.857701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.868068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.869622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:56.884621 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:56.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:56.887065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:56.887065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:56.887065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:56.887065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:56.888300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.896908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1a68e-5feb-4beb-8408-40e222a09abd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:56.939998 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:56.940664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:56.940941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:56.941205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:56.954228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:56.956532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:56.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:56.974690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:56.976666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:56.976666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:56.976666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:56.985278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 296/598] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:56.985278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:56.992010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4dc46-0a14-4bb9-a9f5-1c6db3031abd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.007320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.028716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.030145 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.031161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.031603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.031879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/7fa68549998f496ca54350b3bcec0bef/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.048516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=7fa68549998f496ca54350b3bcec0bef, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.050067 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.065164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 303/599] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:56 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/7fa68549998f496ca54350b3bcec0bef/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:57.066373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.128574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8889f-4d5d-4f43-b187-b93a5c9f4e95 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.219166 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.220550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.221047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.221709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.222635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:57.229293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.231005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.259280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf135-73b3-42f8-92b7-f13e8a220b08 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.267776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 297/600] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:57.273322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.300027 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.300946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.301235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.301532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.302183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:57.302484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.303909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.318125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:57.323485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.361456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.445172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922fd63-b6a1-4476-8f77-571e820ac4f0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.449552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.452578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a17327-5de8-4227-b848-1a1e4b3ec4a5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.491695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.492710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.494228 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.495193 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.509496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.510286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.511308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.512905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.513389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.513809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.530300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.531942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:57.535616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:57.536665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:57.537789 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:57.540833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 305/602] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:57.550371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:57.555341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:57.556422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:57.557571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:57.561371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 298/603] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:57.566922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.736528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185960-5e01-43c6-a035-faec9a9a4d12 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.757988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b85b9f-cf46-49a0-a33c-6939f95e382d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.774833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355386-ca14-420a-b636-9207b409edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.775639 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355386-ca14-420a-b636-9207b409edbf None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.776059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355386-ca14-420a-b636-9207b409edbf None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.776470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355386-ca14-420a-b636-9207b409edbf None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.777310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355386-ca14-420a-b636-9207b409edbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:57.777751 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355386-ca14-420a-b636-9207b409edbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.779846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355386-ca14-420a-b636-9207b409edbf None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.793643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.794071 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 306/604] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.798785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1b0a-34cb-4d7b-ae29-b3a82ee885de None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.800587 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d69a1-4b53-432a-a2e3-0a64aeab7167 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.801029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d69a1-4b53-432a-a2e3-0a64aeab7167 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.801471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d69a1-4b53-432a-a2e3-0a64aeab7167 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.803076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 307/605] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:57.803881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d69a1-4b53-432a-a2e3-0a64aeab7167 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.818063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 299/606] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:57.819529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.819889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.820243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.840516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:57.841953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:57.856671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.912803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d69a1-4b53-432a-a2e3-0a64aeab7167 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:57.926683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 300/607] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:57.928005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:57.950849 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:57.951898 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.952455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.952924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/6d02936fe7de42d7a441bdb0e0d60fc8/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.969101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=6d02936fe7de42d7a441bdb0e0d60fc8, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:57.970968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:57.973560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:57.989075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 308/608] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:57 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/6d02936fe7de42d7a441bdb0e0d60fc8/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:58.050644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6482e8f-c44b-4efb-9a9c-dc209561cb18 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.089755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.090422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.090698 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.090987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/50516a9eb95f42129b257c5b71b782a8/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.108277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=50516a9eb95f42129b257c5b71b782a8, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.109845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.119086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:58.129464 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 301/609] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:57 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/50516a9eb95f42129b257c5b71b782a8/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:25:58.271491 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.393632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958106b2-f391-4f01-a5fa-dad383504507 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.445985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.446614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.446934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.447212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.460265 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:58.465004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:58.466041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:58.467519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 309/610] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:58.472632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.575371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93023b-a5f5-43d5-a1a7-fc64ee447e30 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.611059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.611658 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.611935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.612205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.612875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:58.613178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.614565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb54ef7-5901-4409-8433-a51ae5af9da8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.628960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 302/611] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:58.634474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.712440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:58.762303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcab1c-679c-4fa9-8327-8cf92810b3f3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.804834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.805487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.805768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.806036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.820993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.822485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:58.839775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:58.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:58.842464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:58.842464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:58.842464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:58.842464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 310/612] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:58.844574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38dbe9-f496-4037-b611-0da92f7456bc None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.845123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38dbe9-f496-4037-b611-0da92f7456bc None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.845123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38dbe9-f496-4037-b611-0da92f7456bc None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.846549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 303/613] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:58.847403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.862620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.862897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.863174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.918282 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:58.919504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:58.969158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed7329-79f6-4238-bcdd-87d5cbd57da3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.981302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.022005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.037133 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.037792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.038148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.038428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.039080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.039381 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.040747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.045292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 304/614] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:25:59.053658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 311/615] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:59.059055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.171244 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22976699-c805-4ae9-88a5-5a9fdc41f5ca None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.209222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.209940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.210216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.210487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.226131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.227507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:59.242667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:59.243642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:25:59.244665 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 305/616] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:25:59.249530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.363165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283a9cf-a7c0-4c9f-9fe5-0d66eca8b6db None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.421679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.422332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.422610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.422881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.423619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.423918 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.425369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.443724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 312/617] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:59.450487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.461528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.499302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.562965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.623443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a292-32c7-47fb-bfbf-e9dd3e122623 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.650680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775605f-2cc4-4b5f-a217-02b333170535 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.663844 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.664467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.664744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.665024 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.720340 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.720966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.721242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.721534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.734794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:59.739779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:59.741978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:59.744073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:25:59.745529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.745672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 313/618] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:59.745809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd94b3-7b77-4420-a328-8c7c5a412ed7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.759283 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.798557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.865159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 306/619] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:25:59.867350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d90a-f637-4723-a052-5599afe6c23e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.867818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d90a-f637-4723-a052-5599afe6c23e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.868282 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d90a-f637-4723-a052-5599afe6c23e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.876046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 307/620] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:59.876046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d90a-f637-4723-a052-5599afe6c23e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.891044 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.913022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a0d9-0f95-4d1d-bf6d-e8f8905ba608 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.955209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.955966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.956251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.956523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.957535 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.957857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.959553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d5c3-f906-4553-9660-5d661adbabb0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.975245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 314/621] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:59.975245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.975245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.975245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.997440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:59.999178 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:00.021441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d90a-f637-4723-a052-5599afe6c23e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.068154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.069056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.069353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.079949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.081415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.089847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 315/622] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:00.091048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:00.097429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:00.098416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:00.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:00.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:00.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:00.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 308/623] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:00.103970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.106751 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.174572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.200706 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15686-2bd3-4e8a-9f97-8e9650de7a74 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.213764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfcfce-4890-449d-8cbd-1eef1829deae None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.236660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.237673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.238157 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.238638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.249671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.250266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.250545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.250865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.251474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.251588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:00.251848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.253202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.253654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.266789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 309/624] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:00.270089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:00.271337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:00.272270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:00.272270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:00.272270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:00.272463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.277357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 316/625] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:00.279980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.354175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.396806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311880fd-504b-4dc6-8fde-9a4ba4ba1cef None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.415557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b464-5648-4beb-91f2-821d656db9c4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.444945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.454658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.455730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.456301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.456938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.457920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:00.458258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.458744 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.458930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.459164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.459434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.461146 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.466913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.468350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.479277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 317/626] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:00.479933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:00.480847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:00.482858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 310/627] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:00.484378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.487221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.594173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d84d-5867-4368-a066-0fae572b94df None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.603747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3957-6c6e-4987-b2d9-12ba482fc940 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.630273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.636086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.636990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.637493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.637976 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.644011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075928-6337-484b-a219-7aab2e602eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.644611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075928-6337-484b-a219-7aab2e602eec None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.644889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075928-6337-484b-a219-7aab2e602eec None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.645158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075928-6337-484b-a219-7aab2e602eec None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.646320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36075928-6337-484b-a219-7aab2e602eec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:00.646505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36075928-6337-484b-a219-7aab2e602eec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.647879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36075928-6337-484b-a219-7aab2e602eec None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.648842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:00.653668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:00.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:00.655449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 318/628] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:00.656161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.661292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 311/629] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:00.661960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663f8d-f8d1-4c20-9626-e8d5063bb7e3 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.662247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663f8d-f8d1-4c20-9626-e8d5063bb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.662522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663f8d-f8d1-4c20-9626-e8d5063bb7e3 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.663839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 312/630] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:00.664526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663f8d-f8d1-4c20-9626-e8d5063bb7e3 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.714501 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.767121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92839-79a8-4a1f-81f3-fb41b49a3bb3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.773700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663f8d-f8d1-4c20-9626-e8d5063bb7e3 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.803500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.804685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.805015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.805413 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.809273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.809881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.810674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.810941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.811597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:00.811893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.813234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.813371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.814837 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.826474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 313/631] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:00.826474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b20ff681-eb39-438a-9fa7-a40a23ed2e76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:00.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:00.833249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:00.834236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 319/632] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:00.834855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.835834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.835834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.856519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:00.857738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:00.876755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.926240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 320/633] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:00.926874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:00.945280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21be1-373f-401f-a8fd-596395a07de8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.977244 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.977790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:00.979179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.979764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.980370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.982801 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:00.983317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.985061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.992071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 314/634] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:00.993190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.082945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340739ab-754c-43db-a464-5bb73e8da037 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.131202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.131774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.132058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.132331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.149768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.151870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-560bef73-c317-4920-8500-460d48d6c6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:01.173458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:01.174450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:01.175324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:01.175324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:01.175324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:01.178004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 321/635] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:01.179690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db40be-2df9-423d-a19e-b4d0da36bd68 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.180207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db40be-2df9-423d-a19e-b4d0da36bd68 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.180671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db40be-2df9-423d-a19e-b4d0da36bd68 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.187081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 322/636] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:01.187081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db40be-2df9-423d-a19e-b4d0da36bd68 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.206460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbc00e-a629-4ebf-92ce-d969d48439a6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.217127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.247942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.248542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.248820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.249090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.249854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:01.250973 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.251576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612e57-036d-44c3-9ed6-3cfe2888effc None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.270864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 315/637] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:26:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:01.272088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.272470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.272747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.295930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:01.296705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.297342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:01.308422 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db40be-2df9-423d-a19e-b4d0da36bd68 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.343410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.344007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.344281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.344547 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.345182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:01.345516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.346864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.357927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 323/638] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:01.358628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.375113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 316/639] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:01.378276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.487353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df4f-0064-4bbf-9d10-66b14e391637 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.493553 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.501370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55307d-409e-4faa-8e95-baca1efa064c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.525555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.526273 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.526452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.526703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.538075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:01.543647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:01.544748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:01.545604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 324/640] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:01.546305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.551199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.552095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.552570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.553055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.559243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.570147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.572699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:01.594034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:01.595214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:01.596301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:01.596301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:01.596301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:01.598287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 317/641] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:01.599741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.659722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341500e-11b2-4956-b312-9673a44581a8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.696391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537251-885e-4d7e-8b03-83399256059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.697009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537251-885e-4d7e-8b03-83399256059c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.697301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537251-885e-4d7e-8b03-83399256059c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.697872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537251-885e-4d7e-8b03-83399256059c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.707241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537251-885e-4d7e-8b03-83399256059c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.709079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537251-885e-4d7e-8b03-83399256059c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.709484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d53b-7dd3-4341-884c-7f54feda34d3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-55537251-885e-4d7e-8b03-83399256059c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:01.724294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:01.725403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:26:01.726345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:01.729582 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 325/642] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:01.730528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537251-885e-4d7e-8b03-83399256059c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.747168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.748294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.748568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.748836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.749653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:01.749840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.751181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.759637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 318/643] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:01.760432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.776446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.810679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:01.843482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537251-885e-4d7e-8b03-83399256059c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.866740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9655e5-368a-462c-b4a2-767e5eb29441 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.879132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.879730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.880115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.880439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.881185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:01.881509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.882865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.895343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 326/644] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:01.896148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.906572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.907201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.907792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.908070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.918478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:01.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:01.925011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 319/645] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:01.926033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.001951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.007923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa543b9-f716-4bcb-8c4f-fb8261d627d1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.036552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eff25-e8f4-4454-8cb8-a85b8fa8b42c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.039903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.047278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.047878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.048154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.048418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.049134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:02.049464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.050872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.069083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 327/646] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:02.069701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.076366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.076982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.077274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.077552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.088402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.089874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:02.104578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:02.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:02.106471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:02.106471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.106471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:02.106471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 320/647] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:02.106471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.179039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50c1e1-c6e1-40e2-8987-6850d98ab3a8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.208936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc067-8351-4091-a21f-9cc27508fe0b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.213498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.214121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.214394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.214662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.222206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.223755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.231741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:02.236817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:02.237750 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 328/648] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:02.238653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.250023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.250621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.250944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.251213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.251924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:02.252228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.253631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.262189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 321/649] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:02.262976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.297039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.354435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a85b-7cb1-49f3-989e-11fceb6d3bde None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.369800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da567-6ffb-4e05-bcdf-834ca7789ef9 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.389715 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.390315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.390593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.390869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.409836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.410786 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.411282 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.412259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.413412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:02.413717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.415577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.432600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 322/650] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:02.432600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.462365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.464284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.478336 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.514717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.539470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4f45-5f00-4ab1-a7ed-8aa84205f8b9 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.571431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 329/651] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:02.571431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.579531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.580125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.580402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.580662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.581390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:02.581693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.583093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.599830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 323/652] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:02.599830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.680640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce02c6-6fa5-48b9-b56f-1d1495f018f9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.712314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d4d4-a18b-4824-8bfc-a9995e83cb7b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.715061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.715511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.715742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.715843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.716037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.727152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.728741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.737350 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:02.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:02.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:02.746068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:02.746068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.746068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:02.749014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.749677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.749953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.750222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.752124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 330/653] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:02.753221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.758322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.759770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:02.771922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:02.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 324/654] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:02.774433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.865677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c7f21-a4ea-4706-a936-059bcf63c901 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.875794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc640-c3d6-414b-a0f5-f919ce38ba8c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:02.901601 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.902678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.903119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.903529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.909765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:02.910449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.910728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.911001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/bf7c613ffbc6445296b63c1083ac8357/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.916269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.917938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.926360 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=bf7c613ffbc6445296b63c1083ac8357, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:02.927777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:02.933578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:02.935768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:02.937627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:02.937627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:02.937627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:02.940438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 331/655] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:02.941428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.953291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 325/656] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:02 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/bf7c613ffbc6445296b63c1083ac8357/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:02.953291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.969055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.023141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.076683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b7d4-fae7-4fb5-bf69-54f27528fce7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.082070 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233b92-ac27-41fb-a3b7-8fd19c568848 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.115682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.116556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.116907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.117408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.118228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.118654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.120129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.122200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.123348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.123624 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.123998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.124644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.124943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.126380 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.141600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 332/657] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.141810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 326/658] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.142744 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.151703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.234206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.260939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585afafc-e0c5-439a-9551-bbc6751d1188 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.272691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525740f-ae6b-4263-bbf1-3187b0e7d803 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.280482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.304271 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.304873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.305150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.305456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.306098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.306401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.307762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.311438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.312065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.312346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.312620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.324317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 333/659] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.324486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.324589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.324677 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-07b0dfd1-7218-485a-b729-8e5722f114ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:03.338723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:26:03.340595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:03.344419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 327/660] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.345568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8703-445f-4173-aed5-db591b5e4013 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.345854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8703-445f-4173-aed5-db591b5e4013 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.346131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8703-445f-4173-aed5-db591b5e4013 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.347373 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 328/661] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:03.348067 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8703-445f-4173-aed5-db591b5e4013 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.435424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e53b-d3a8-4cb7-ac8d-471d386e8164 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.463018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8703-445f-4173-aed5-db591b5e4013 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.471307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.471907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.472178 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.472445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.494819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.500356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.501009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.501312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.501586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.508493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.509959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.516671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:03.522026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.523104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:03.524236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:03.527831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 329/662] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.528529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.548626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.550188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308548f-a4ac-437c-8b1c-7252cf87371a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.634720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1d43-65cf-4020-80bd-1b8ce1ed01e5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.653302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 334/663] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:03.653302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.653302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.653302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.671314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:03.672551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:03.677522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.678124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.678399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.678670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.679394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.679694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.681552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.701505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 330/664] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.702337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.757356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 335/665] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:03.757356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.757630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.758103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.813423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a15816-84f5-435c-932f-b4034794dcf8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.851012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.851964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.852441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.852955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.853864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.854370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.856209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.870739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 331/666] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.871940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.877379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14df49-2340-4282-8d91-1a9377d85a08 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.918895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.920188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.921015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.921330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.934089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.936709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:03.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.956007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:03.956920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:03.956920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:03.956920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:03.961030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 336/667] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.961896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.988926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d6c21-ef2a-4c8d-97f3-f8459023497a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.005982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.035504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.036747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.037879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.038931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.039813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.083079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476542-cc48-4a1d-9cf6-29227940b9e0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.111986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.113470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.118574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.119175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.119450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.119721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.120483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=7fa68549998f496ca54350b3bcec0bef) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.120907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.122970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.133607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 337/668] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/role_assignments?user.id=7fa68549998f496ca54350b3bcec0bef&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.134939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.234541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 332/669] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:04.235946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.248693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.255614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a59e37-dbe9-4735-81ec-73d5f1f627c4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.281781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.297284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.297972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.298247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.298530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.299204 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.299512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.301001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.315550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 338/670] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.316498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.363230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be568-1121-4383-b2bc-88fe2613c6e5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.421843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.422500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.422749 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.423017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.437671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:04.438534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1a5a-b121-4373-b104-48d448ce6c8e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:04.443650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:04.444577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:04.445485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 333/671] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:04.446202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.492633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.493696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.494175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.495102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.509679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.511387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.526413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:04.527598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:04.529756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:04.531063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:04.531063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:04.531063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:04.531485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 339/672] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:04.532463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.566268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.569103 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e171c6-5c3e-41fd-85d7-487ee74c1443 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.613108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.613766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.614042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.614317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.621784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.623547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:04.637700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:04.638653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:04.639537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:04.643941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 334/673] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:04.645426 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.648434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e0bc-9379-4884-a3c4-c575de921f39 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.686065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.687031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.687517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.687994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.688894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.689451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.691122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.706090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 340/674] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.707397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.762829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13210d-fadf-41a2-8448-ac7bf2b24d00 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.801625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.810426 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.811327 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.811827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.812804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.813946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.814423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.815959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.816986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.829646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302691f2-2f09-48ff-af7d-76e02129c971 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.831351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 335/675] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.833209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.876394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.877321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.877799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.878244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.879103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.879589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.881181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.898584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 341/676] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.899689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.953995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c516c1-e2a5-4129-b9c2-0f78989fcf94 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.995374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.996032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.996241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.996513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.007720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4dc2-1550-46cf-a621-25c0fea52b4a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.011770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.013925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:05.033408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:05.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:05.035322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:05.035322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:05.035322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:05.037418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 336/677] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:05.039295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.061392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.062052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.062335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.062610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.073058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.075232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:05.092334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:05.093286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:05.094175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:05.097401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 342/678] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:05.098403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.100708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.117078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.181578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9285-d6ad-4418-a27b-c4bad6181ea4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.207870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe431-3fb9-4f26-8b51-a8c267e7505a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.216623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.217224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.217527 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.217800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.218528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=6d02936fe7de42d7a441bdb0e0d60fc8) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.218833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.220245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.233303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 337/679] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/role_assignments?user.id=6d02936fe7de42d7a441bdb0e0d60fc8&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.233303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.253404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.254017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.254292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.254563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.255217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.255517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.256919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ad33-9d4d-415e-8101-f33af23f8a90 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.270705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 343/680] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.272089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb61-2970-41b6-b46e-66890ee40181 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.272361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb61-2970-41b6-b46e-66890ee40181 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.272637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb61-2970-41b6-b46e-66890ee40181 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.278190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 344/681] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:05.279609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdb61-2970-41b6-b46e-66890ee40181 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.346923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695400e-7277-4fd1-9677-303a214fd17f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.357193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.358284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.388516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.389222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.389539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.389819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.390537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.390847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.392468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdb61-2970-41b6-b46e-66890ee40181 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.392583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264156-0263-473f-938a-0e6fdc2b3516 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.412202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 338/682] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.421281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.421281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.421281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.431495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.432121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.432395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.432661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.435886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:05.437084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:05.441062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.442525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:05.455014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:05.455957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:05.456891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 345/683] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:05.458157 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.524219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 339/684] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:05.525850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.612121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998649-7472-4293-b5db-56d4f68c3324 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.665291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.666757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.667360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.667634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.667903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.668650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=50516a9eb95f42129b257c5b71b782a8) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.669752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.671818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.678037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 346/685] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/role_assignments?user.id=50516a9eb95f42129b257c5b71b782a8&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.698503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4cdb7-f5f5-4eab-8163-2b983dfc1007 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.702851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:05.737153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.738183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.738671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.739154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.740099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.740607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.742293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.761659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 340/686] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.769317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.810392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.926512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b289d4-2633-402b-a8bc-323007fd2985 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.967452 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.969116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.969657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.970129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.982993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:05.989151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:05.990137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:05.990976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:05.994078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 341/687] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:05.995280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2323cb8-80f5-4e3f-9106-fe878a250a3e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.996435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.030502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.042919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.042919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.043229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.043485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.126728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.129158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d359-505f-4ae3-b297-3f0b6c430fe5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.138510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.140803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.193478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.194010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.194289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.194562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.195234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:06.195535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.196899 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.218791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 342/688] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:06.224805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.302014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 347/689] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:06.307721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.389292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.439079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877190b-9153-4575-a620-3d0cee9d8d5c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.459470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.469127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d8c-5b62-42c6-8ce2-1fd2245aa91c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.498508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.499159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.499500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.499825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.514168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.515655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:06.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:06.533304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:06.534213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:06.534213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:06.534213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:06.534213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 343/690] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:06.535043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.535670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.535941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.536204 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.542387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.560841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.562662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:06.589182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:06.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:06.591274 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:06.591274 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:06.591274 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:06.593765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 348/691] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:06.599576 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.694371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252d22-e2c6-46be-913b-220c72789fe7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.722721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.732381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.733223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.733717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.734129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.735063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:06.735618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.737123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0613d3-5147-4b50-a862-68238b641eaa None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.742109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192c5c1-af50-4a13-a6a9-b4d326fb8fa0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.755637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 344/692] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:06.757196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee87b0-2715-426c-8949-75b7ec0dc7a4 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.757726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee87b0-2715-426c-8949-75b7ec0dc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.758198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee87b0-2715-426c-8949-75b7ec0dc7a4 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.760184 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 345/693] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:06.761346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee87b0-2715-426c-8949-75b7ec0dc7a4 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.789489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.790448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.790802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.791154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.792119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:06.792490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.794759 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e023b-f80f-4925-ad40-f94be6fbc1c6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.812627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 349/694] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:06.814161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.814519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.815105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.835964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:06.837476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:06.839783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.886816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee87b0-2715-426c-8949-75b7ec0dc7a4 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.914476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 350/695] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:06.915552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.947409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.948295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.949015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.949406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.967093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:06.969826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:06.991824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:06.992742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:06.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:06.996384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 346/696] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:07.006429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.094781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb681c-2439-4c5a-a724-ef24c8fb544c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.108538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.159432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.160303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.160741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.161150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.173455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.175309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.177342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:07.191606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:07.192548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:07.193468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:07.196266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 351/697] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:07.201868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.204242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357902a-24b5-4a2b-a45e-d7fe09633a0d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.249392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.250497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.251037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.251515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.252466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.252963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.254802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.274953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 347/698] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:07.276157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.348208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef52d1-6b3d-4a42-a38c-183ca1713f5b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.383988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e8d1c-debc-42c5-a8c0-085d0f13bc98 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.392530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.404755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.405380 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.423684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 352/699] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:07.424857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.442222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.442850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.443128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.443399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.455814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.457594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:07.478945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:07.479906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:07.481435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:07.481435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:07.481435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:07.481435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 348/700] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:07.481435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.501907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.558203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26e690-56ff-46c8-9660-6e0379724ff4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.598817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e9b1-0ee1-49f7-9d8e-471414de2836 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.641002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.641670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.641951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.642280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.643027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.643378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.644917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.656784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 349/701] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:07.657915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.709043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.748864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.750232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.750710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.751197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.829508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49103886-c992-42af-a7c0-151f61cb47d4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.831574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.833235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dd67a-1b4f-4a13-bbd2-5b770c019bd0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.871540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.872186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.872469 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.872742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.873429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.873734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.875108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46604-2f71-43d3-b344-7cc0fa3d3309 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.888993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 350/702] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:07.890341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a830ad-e56a-45ad-928d-1c3823665b99 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.890634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a830ad-e56a-45ad-928d-1c3823665b99 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.890913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a830ad-e56a-45ad-928d-1c3823665b99 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.892280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 351/703] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:07.897822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a830ad-e56a-45ad-928d-1c3823665b99 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.913379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.965270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 353/704] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:07.967500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5346db-1bea-4ce0-88b6-fc2ce13647d5 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.968379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5346db-1bea-4ce0-88b6-fc2ce13647d5 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.969201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5346db-1bea-4ce0-88b6-fc2ce13647d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.995008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.000969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-9e5346db-1bea-4ce0-88b6-fc2ce13647d5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:08.003818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9e5346db-1bea-4ce0-88b6-fc2ce13647d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:08.017590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a830ad-e56a-45ad-928d-1c3823665b99 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.059717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.060869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.061151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.061449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.062096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.063528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.088128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 352/705] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:07 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:08.088893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.098688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 354/706] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:08.253467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198007f-a600-4ad6-9570-877d0886a7af None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.285450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed180-5935-4b1e-a7ff-529271edb390 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.286247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed180-5935-4b1e-a7ff-529271edb390 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.286850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed180-5935-4b1e-a7ff-529271edb390 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.292992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 355/707] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:08.296311 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.296593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.296867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.305917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.306881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.307155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.322203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.328459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:08.329701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:08.336250 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.337764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:08.359505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:08.361478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:08.361478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:08.361478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:08.363793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 353/708] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:08.368769 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.416688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 356/709] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:08.467910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.489643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.490141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3b01-3954-4dc5-987a-7a7cc551e70c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.532868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.533511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.533785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.534056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.534702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:08.534998 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.536367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.551279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 354/710] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:08.557034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.597244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6963ac-120c-4fbc-9d4c-c32a4de12bc6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.622399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.648474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.649427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.649847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.650256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] PATH_INFO: `/v3/services/network` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.650988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.652992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.669421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:08.671822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:08.674636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 357/711] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:08.680947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.696386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3f981-a2b4-4b33-90c0-8163c2d64af2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.751750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.752619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.753044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.753489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.763676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.765898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.772415 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:08.784542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.785764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:08.786900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:08.789477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 355/712] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:08.790934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.798121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d7ad-fc0e-4c0f-88ba-48dd2126742d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.843212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.843767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.844138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.844522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.845281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:08.845669 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.847120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.851975 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 358/713] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:08.852828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.938584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687b5e-2b1f-42bb-a48f-57000fb8cd61 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.951911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.976240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dd625-5396-419d-89d1-7415d936b8e4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.984587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.985989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.986271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.986542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.987129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.988483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:09.005167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:09.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:09.007688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 356/714] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:09.008516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.031639 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.032658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.033137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.033638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.034663 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.035217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.036952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.052223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 359/715] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.053696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.067867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.124472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0503e-44c6-4e58-9f5a-c1ba062c2074 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.162623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.163266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.163512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.163783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.164409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] RBAC: Adding query filter params (type=network) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.164705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.166082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.181360 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 357/716] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.182432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.193737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677710a-8e76-47a3-aa17-8e42a5012ba3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.234702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.235411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.235769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.236097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.236807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.237200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.238816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.244207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.254373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.300865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.349526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.417058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd4d3-a61d-4523-8755-0ba6cac81446 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.434284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf030f-1df3-421a-8c4f-d4227747e39e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.468981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.469611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.469831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.470082 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.470713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.471010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.472361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed22084-48cd-47b8-9285-b212b1b257dd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.478381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.479457 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.479948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.480426 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.480597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 361/718] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.481577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=bf7c613ffbc6445296b63c1083ac8357) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.482106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.483786 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd3426-8929-429f-9bd8-6316973bb2a0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.495904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 358/719] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/role_assignments?user.id=bf7c613ffbc6445296b63c1083ac8357&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:10.044445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde10-d482-4eb7-9174-a98137904410 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.044982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde10-d482-4eb7-9174-a98137904410 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.044982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde10-d482-4eb7-9174-a98137904410 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.046630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 362/720] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:10.052143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.052430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.052704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.081519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:10.082716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:10.169200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 359/721] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:10.527780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dde10-d482-4eb7-9174-a98137904410 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:10.662969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dde10-d482-4eb7-9174-a98137904410 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:10.712718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:10.713755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.714307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.714770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.717128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:10.731715 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-be9396fc-6cc7-4b91-8d69-ab2178e147f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:10.737120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:10.738158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:10.738984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:10.741955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 363/722] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:10.748339 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:10.806466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:10.871048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52bec3-59ea-4e0b-aa42-f10cb749061d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.871417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52bec3-59ea-4e0b-aa42-f10cb749061d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.871586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52bec3-59ea-4e0b-aa42-f10cb749061d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.878146 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 364/723] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:10.899488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.899781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.900034 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.903547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db9f26-595c-4031-8721-eda7b7fd16b2 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:10.934282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:10.935503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:10.945247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:10.945869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.946252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.946522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.947175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:10.947472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:10.948904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:10.964643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 360/724] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:10.970894 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.058386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 365/725] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:11.088341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.101110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798834c0-4714-4a05-8763-7ee86d72cd05 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.234082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.234679 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.234928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.241276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.270301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.271762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:11.297219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:11.298222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:11.299111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:11.299111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:11.299111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:11.302877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 361/726] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:11.308412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.368799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.509815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371daf-c021-410b-a5d9-b7a147b484b8 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.560216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.589981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.590610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.590887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.591157 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.591799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:11.592097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.593489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.623548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 366/727] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:11.634630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.636275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaec69-0af1-4136-a6b6-ae3c9105926d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.746532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.749279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.749279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.749279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.774451 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:11.779816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:11.780741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:11.781602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:11.789827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 362/728] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:11.798265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.798779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e470f-1248-4187-ae5c-ab2c589102ae None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.816837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.843474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.844126 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.844463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.844737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.855428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.857025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:11.889331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:11.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:11.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 367/729] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:11.895291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.960777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5de3d-75b6-4044-91c1-6a647bab868f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.978079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.996763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.997427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.997707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.997977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.998644 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:11.998945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.000294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe2e89-7559-412a-9b7e-91a505e42e28 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.009194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 363/730] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:12.011037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052b18-e356-4feb-82b9-2bf106e25b64 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.011330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052b18-e356-4feb-82b9-2bf106e25b64 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.011606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052b18-e356-4feb-82b9-2bf106e25b64 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.013121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 364/731] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.015425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5052b18-e356-4feb-82b9-2bf106e25b64 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.048340 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7665bf5-6b64-4a28-8381-0c6321999f43 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.092665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.093324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.093685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.094025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.094869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:12.095516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.097157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.101111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2c00-f9f9-4acb-8088-130f9e449887 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.131365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 368/732] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:12.131365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.131365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.131365 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.147882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5052b18-e356-4feb-82b9-2bf106e25b64 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.151000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.152009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.190061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.191753 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.192239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.192686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.206783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.208781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.224814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 369/733] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:12.225841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:12.227020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:12.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:12.228798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:12.228798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:12.228798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:12.231560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 365/734] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:12.242540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.281922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.430176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dac2-6f26-4e15-b42c-1391a3ff714f None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.459733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9405-1246-4f1f-95c4-6de88f229d0b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.479938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.480836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.482221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.482573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.483143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.494332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.495126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.495726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.495822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.496002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.496271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.497482 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:12.497794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.499129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ad3c-a33c-4370-bf82-84863ed75915 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-55030786-4481-4a7f-ae0f-18c37a7d1452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:12.510725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:12.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:12.512606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:12.512606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:12.512606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:12.512788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 366/735] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:12.512858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 370/736] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:12.512924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9496c-e21e-458b-9654-871d1cc14fd8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.512924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9496c-e21e-458b-9654-871d1cc14fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.513523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9496c-e21e-458b-9654-871d1cc14fd8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.513635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902520c7-8745-43a6-aab7-fc31aff1086f None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.513635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902520c7-8745-43a6-aab7-fc31aff1086f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.513774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902520c7-8745-43a6-aab7-fc31aff1086f None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.517437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 367/737] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.517631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 371/738] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.517631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902520c7-8745-43a6-aab7-fc31aff1086f None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.518329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9496c-e21e-458b-9654-871d1cc14fd8 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.600970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.617813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902520c7-8745-43a6-aab7-fc31aff1086f None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.618105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9496c-e21e-458b-9654-871d1cc14fd8 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.650911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.651015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.651184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.651447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.651545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.651792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.652063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.652151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:12.652359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.652709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.653767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.654081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f169f7-3daa-4063-9462-b710affe4954 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.665155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 372/739] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:12.665947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.669646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 368/740] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/services => generated 240 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:12.670880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5f62-b2b1-4528-ad40-856cb2ca4e31 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.671000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5f62-b2b1-4528-ad40-856cb2ca4e31 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.671212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5f62-b2b1-4528-ad40-856cb2ca4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.691619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-62fc5f62-b2b1-4528-ad40-856cb2ca4e31 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.693020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-62fc5f62-b2b1-4528-ad40-856cb2ca4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.731979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.783164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33760cf-2d6e-42c6-9bd9-9678fdd4ed61 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.784366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 369/741] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:12.785868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.786155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.786435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.810938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.812174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.832668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.833455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.833850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.834127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.843858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.845927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:12.861431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:12.862404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 373/742] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:12.863338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.867909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.897275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 370/743] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:12.898069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.979102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386551f-2959-4409-8e4c-26d2169d93eb None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.017638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.026032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6329-fbb1-4171-9836-5e12468723d7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.028853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.031155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.031901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.032420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.048564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.050327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:13.072594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.073564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:13.074466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:13.082354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 374/744] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.085198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.093999 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.094794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.095212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.095624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.096993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:13.097480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.099406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.124295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 371/745] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:13.125390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.158689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.209462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad337b-e7aa-45b4-b1f1-efb18dd935ed None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.234864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3f284-3304-41e1-8fcb-1db96d8d783a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.247711 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.248331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.248604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.248871 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.259520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:13.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.269771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 375/746] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.277637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.278838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.279096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.279370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.280515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:13.280825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.282652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.301390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 372/747] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:13.301390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.319217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.379267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f62f4-cf04-4f73-8d21-de05a8f76e12 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.403863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.415095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98b0b-8fad-4520-9888-d285b7330d04 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.417077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.418504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.418913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.419185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.450663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45374178-273d-415d-856b-00334a458eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.451258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374178-273d-415d-856b-00334a458eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.451639 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374178-273d-415d-856b-00334a458eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.451806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374178-273d-415d-856b-00334a458eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45374178-273d-415d-856b-00334a458eb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.453837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45374178-273d-415d-856b-00334a458eb7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.469537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 373/748] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:13 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:13.469537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45374178-273d-415d-856b-00334a458eb7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.514013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.515408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.559726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.597994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45374178-273d-415d-856b-00334a458eb7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.640298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.640298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.640298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.640681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.641238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:13.641623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.643584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.657413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 374/749] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:13.658236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.669875 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 376/750] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:13.671075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.705651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.775982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4742d3-02be-44ed-8423-02bc1b9cda62 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.805011 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd868b13-f758-43e2-b0fb-2257825ea59c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.810024 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.817862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.819597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.820090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.820563 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.823259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=1ae0aa2cf16f420db7bcb87d4d995901, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.825316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.844112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 375/751] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:13 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:13.849321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.849321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.849321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.849321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.851136 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.860573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.863275 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:13.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:13.884393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:13.884393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.884393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:13.884393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 377/752] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.891195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.027542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.070249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ed9a-c9fa-4f94-b6bc-7179cbc2a381 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.072229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875545-2d48-4600-bb21-ccfb61a860b8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.122042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.122369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.122657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.122886 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.122996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.123167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.123265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.123440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.124108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.124393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.126657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.138893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.140634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 378/753] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:14.148368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:14.157819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:14.158775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:14.159656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:14.159656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:14.159656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:14.159656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 376/754] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:14.165629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.213651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.274956 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6757-2975-4517-ba56-625c8240c74e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.291053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ba15-395b-406b-bebc-2b952731ca68 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.330013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.331048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.331540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.332031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.338238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.348152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.350430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.351281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.352443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.352918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.353414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.354289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.355206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.356963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:14.376391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:14.377505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:14.378432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:14.382298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 379/755] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:14.388812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.393846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 377/756] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:14.398007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.574121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8d75-df67-4fcf-996c-60f0c1e68ed8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.579674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9ff0-7ffe-4a90-8527-7897c771d09c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.584114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.640742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.641407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.641686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.641961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.643768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.644367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.644641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.644910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.646805 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.647115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.648545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.659210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.660648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:14.681021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:14.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:14.682897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:14.683327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 380/757] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:14.683327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.683456 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 378/758] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:14.689433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.753694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.810249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a26a25-84ba-4d65-bbba-4ee01fc0025a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.879783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.880329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.880612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.880889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.898767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e8d3a-4f7d-46e1-9c07-ce99dd0dc826 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.948807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.949442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.949723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.950036 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.950905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.951225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.952785 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.966969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 379/759] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:14.972738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.002154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.003643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.031530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.069648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.132995 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 381/760] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:15.134957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.181092 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc21cc-e2f1-41b3-9da0-8348245bc200 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.220212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.220968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.221246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.222312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.223059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=b9311a16e8a3495093739c1ce7c1e66f) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:15.223372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.224857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1400d-066a-4197-91a2-fa00068e788f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.232474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 380/761] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/role_assignments?user.id=b9311a16e8a3495093739c1ce7c1e66f&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:15.233726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41629465-56f3-4f6a-a157-c835ed3ec550 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.234008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41629465-56f3-4f6a-a157-c835ed3ec550 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.234338 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41629465-56f3-4f6a-a157-c835ed3ec550 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.237366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 381/762] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:15.242489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.242767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.245300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.267713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:15.268961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:15.276970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84a2d-6b71-4cdc-bbc9-09370022e3b8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.352402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.357732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.358050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.358322 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.371603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.373158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.391214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 382/763] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:15.419090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:15.420115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:15.421061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:15.421061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:15.421061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:15.426909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 382/764] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:15.427910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.460962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.547662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b55b-2251-4d62-ad8d-5c446154e871 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.598615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.599466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.599922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.600337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.601169 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:15.601632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.603192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.615894 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 383/765] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:15.620961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.634263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.712109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.770770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19e50a-3041-4523-a038-6a0f7d5c28e7 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.819869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.822924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.823393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.823814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.840876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.844645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:15.867796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:15.868755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:15.869785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:15.872059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 383/766] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:15.878210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.899589 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.942212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67344b2-6610-44bd-9103-49016326f80c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.995853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.997005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.997463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.997878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] PATH_INFO: `/v3/services/network` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.998631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.999396 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.002979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-9a06ec6d-2ea0-490f-bf73-93d6f69d4942 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:16.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:16.016719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:16.017802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:16.020846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 384/767] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:16.023124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd238ad-4e11-4fd4-8a3f-0c5de53b45d8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.023641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd238ad-4e11-4fd4-8a3f-0c5de53b45d8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.024381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd238ad-4e11-4fd4-8a3f-0c5de53b45d8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.026528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 385/768] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:16.027405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd238ad-4e11-4fd4-8a3f-0c5de53b45d8 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.050937 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea9e73-014f-424d-b491-f50d8a073a2b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.087997 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.088894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.089374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.089822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.090757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:16.091237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.092839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc75990-f3d5-44f5-b56c-934773043c99 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.106652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 384/769] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.108149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.108674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.109153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.129058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:16.130648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:16.147940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd238ad-4e11-4fd4-8a3f-0c5de53b45d8 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.184792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.185440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.185940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.186194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.186854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] RBAC: Adding query filter params (name=network) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:16.187140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.188513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.197824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 386/770] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.198938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.210165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 385/771] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:16.211463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.265770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.276018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.307224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77b9ec-5335-4ffa-9148-c3a17e940156 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.326232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced2dc-c61e-429e-ba3c-d4db508a9280 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.342478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.342834 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.343114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.343388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.344120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=bf7c613ffbc6445296b63c1083ac8357) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:16.344445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.345877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.351669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 387/772] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/role_assignments?user.id=bf7c613ffbc6445296b63c1083ac8357&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.365936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.367346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.367854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.369196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] RBAC: Adding query filter params (type=network) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:16.369835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.371608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb1f5b-6d35-4f2e-8688-72c1d2b72caf None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.378356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 386/773] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.386618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.438249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8011ab-f516-4213-bd9a-6b99fc820b6d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.438890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8011ab-f516-4213-bd9a-6b99fc820b6d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.439482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8011ab-f516-4213-bd9a-6b99fc820b6d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.441463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 387/774] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:16.455536 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.456160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.456653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.488070 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:16.491786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:16.539908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.594037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ddeb-1bbb-49d6-9eb3-5736a0583a43 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.617360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 388/775] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:16.618559 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.630282 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.630905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.631163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.631428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.632131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] RBAC: Adding query filter params (interface=public, service_id=b5626dea9ecf4a68bb4b719f2527f023, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:16.632431 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.635563 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.643281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 388/776] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/endpoints?service_id=b5626dea9ecf4a68bb4b719f2527f023&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.650647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.704467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.788959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c62e4f-de5c-4ba0-8d37-6494cc7e11d6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.830218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac98ce-28ba-45d3-b2c9-b9b0d4bb38db None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:16.849824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.850770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.851446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.852443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.853862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.855612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.865098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:16.866315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 389/777] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:16.889694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:16.890730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.891206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.891670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.892463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:16.894079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:16.911151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:16.912210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:16.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 389/778] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:16.918978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:16.930344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.084051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac1356-e896-41d7-8337-c33976b58aec None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.101236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73820e-6a25-412d-a331-59ff4936bc0b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.119602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.127297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.128354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.128958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.129444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.130719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.131270 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.133276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.140089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 390/779] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.144592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.144592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.144592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.144592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.146680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.155017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:17.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:17.161287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:17.162119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 390/780] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:17.167411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.230522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.277234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0e0-5c9b-4fd7-930b-58659869d178 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.289426 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533efa-cc53-4ccb-82e3-0870caa3b45e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.322081 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.322699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.322978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.323252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.324006 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.324313 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.325752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.326581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.327391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.327867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.328339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.329208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.329729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.331259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 391/781] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.331458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.339448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.345884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 391/782] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:17.357280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.401142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.491591 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612bf9-b2ec-4764-b201-6325f1d853d6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.520225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.532177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.532892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.533176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.533481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.534208 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] RBAC: Adding query filter params (interface=public, service_id=586d5e6a190f4fbbb37e67942403dc33, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.534522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.536011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.542631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 392/783] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/endpoints?service_id=586d5e6a190f4fbbb37e67942403dc33&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.553654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.556180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1161b3-9f8c-4db2-b0d3-2de8290e0e35 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.608881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.610645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.611733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.633810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.635821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:17.662206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:17.663222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:17.664112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:17.664112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:17.664112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:17.670890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 392/784] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:17.675529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.756940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214938-d7a8-4bc0-abe0-becfd67ac667 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.805024 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.805671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.805945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.806219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.807140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.808246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cce19-32ce-409b-9730-96bab82d35be None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.813763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 393/785] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:17.815050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bce9d-f9e5-4feb-ba50-b779e10ba2c5 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.815334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bce9d-f9e5-4feb-ba50-b779e10ba2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.815607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bce9d-f9e5-4feb-ba50-b779e10ba2c5 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.820595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.821153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 394/786] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:17.823853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.824415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.825446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.837006 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2779c9-d31a-46e9-b905-49f134466309 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.844441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:17.845941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:17.898077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.899075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.899553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.900213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.902003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.902907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.905321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.940210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 393/787] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.944385 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.960859 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.022632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 395/788] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:18.090063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61d76-2bff-4d49-87b6-eda3c2ab75c3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.125002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.125674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.125954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.126225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.133680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.135122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:18.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:18.149811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:18.150916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 394/789] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:18.157746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.334321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.347532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.469542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a393-5ded-4620-b462-f0538c98a793 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.497541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0999-3f96-4d85-a276-888c7d4aeb30 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.534792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.535409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.535800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.536082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.536931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:18.537376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.538862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.553240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.554225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.554702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.555173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.569117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 396/790] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:18.570078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.587009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:18.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:18.594142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:18.594981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:18.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 395/791] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:18.607521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.648262 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.749166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.763324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9842-a848-4fac-a0ef-93d77981fa55 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.811019 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83040-b047-4573-9b90-fdc9079f9f38 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.837671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.838284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.838564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.838838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.846781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.847649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.847933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.848208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.848876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:18.849183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.850689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.859842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 396/792] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:18.865114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.997576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.000241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75dbffd-2e17-4ef9-99cb-18466635ab30 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.048244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d877-1560-4073-b7ce-df6d4ce7cc54 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.049657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.085098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.086149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.086645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.087108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.097463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.099687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.101125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.114529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 397/793] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:19.116097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8c2-4e16-454f-8a09-0a1b24ba36a8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.116536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8c2-4e16-454f-8a09-0a1b24ba36a8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.116932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8f8c2-4e16-454f-8a09-0a1b24ba36a8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.123072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 398/794] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:19.123072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f8c2-4e16-454f-8a09-0a1b24ba36a8 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f751b158-8434-41e6-ac55-2b3037d35ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:19.128038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:19.128972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:19.129912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:19.129912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:19.129912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:19.129912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 397/795] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:19.130597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.130872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.131137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.150637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:19.151915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:19.236313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 398/796] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:19.236313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.254636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8f8c2-4e16-454f-8a09-0a1b24ba36a8 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.315291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.316364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.316781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.317239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.328717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.330545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.333748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:19.356796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:19.358004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:19.359101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:19.359101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:19.359101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:19.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 399/797] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:19.373221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.418752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f99ee-46da-45ae-b25c-ba3222efb38c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.456203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.497569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.498838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.502037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.502461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.503287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:19.503729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.505296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.529887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 399/798] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:19.535239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.551692 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15ba6-3283-4718-8518-426a579dca9d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.587517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.588184 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.588534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.588868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.589607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:19.590077 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.591820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8fba2-a2e8-47a7-bd03-757cf3e57217 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.603408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 400/799] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:19.604556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cb1b-afce-424d-9059-336a8fad3f51 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.604828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cb1b-afce-424d-9059-336a8fad3f51 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.605094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cb1b-afce-424d-9059-336a8fad3f51 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.609291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 401/800] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:19.609291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5cb1b-afce-424d-9059-336a8fad3f51 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.655903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d28b73-3cc1-4a75-a190-5e1f53a64040 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.664209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.690091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.690714 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.690993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.691272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.699281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.700788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:19.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:19.713175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 400/801] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:19.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.714984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5cb1b-afce-424d-9059-336a8fad3f51 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.749999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.753813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.754941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.754941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.755123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.765653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8e4379b8-9713-4f54-868d-7c5720c50e40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:19.770303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:19.771213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:19.772044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 402/802] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:19.772748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.772748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.773647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.792634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:19.793922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:19.830408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ec951-9aca-4663-8dbb-d5a6f9769986 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.864584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.865212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.865527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.865799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.871001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 403/803] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:19.872600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.882476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.883998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:19.897005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:19.897946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:19.898825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:19.902966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 401/804] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:19.903803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.931702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.997498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2cd99-3fae-42b5-904a-5d135463c8cd None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.010486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.021642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f55e4-5022-4a6a-addd-dfa4cbc229e8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.037592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.038559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.039132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.039731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.040672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.041168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.043106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.058347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.058992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.059274 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.059550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.060354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.060647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.062070 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.064804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 404/805] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.065867 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.071256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 402/806] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.072138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.177088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545ea8b-7bf5-4e63-9815-85de01e3ff21 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.179079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.195395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f567d-445e-4953-9d9f-54a9f7f99181 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.215739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.216374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.216659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.216938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.217717 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.218031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.220153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.233596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 405/807] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.234806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.235521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.235804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.236077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.239721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.249770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.251239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:20.268218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:20.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:20.270450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:20.270450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:20.270450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:20.270450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 403/808] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:20.270450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.282239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.360764 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b58cd-22f3-43d2-842a-d9bfc2dbf23f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.384698 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbefe41-9ff3-4318-8ead-e33cec0fdb11 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.394959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.395577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.395853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.396126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.406712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.408471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:20.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:20.426584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:20.427811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:20.427811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:20.427811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:20.427811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 406/809] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:20.427811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.429467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.430093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.430368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.430641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] PATH_INFO: `/v3/services/network` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.431284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.432649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:20.442478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:20.443552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:20.444407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 404/810] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:20.445826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.446330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.514725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.530815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76133-d457-4447-ab4e-f438c6fe9632 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.545710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fa808-0708-4967-acf4-df0133bc7f11 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.564051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.564643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.564921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.565195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.565945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.566337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.568442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dad1ba-238e-45ce-8c54-3af03bdaa7f3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.574096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 407/811] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.575875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fc83-c7a1-4eee-88d3-09dfcca73df2 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.576155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fc83-c7a1-4eee-88d3-09dfcca73df2 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.576427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fc83-c7a1-4eee-88d3-09dfcca73df2 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.577837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 408/812] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:20.578329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2fc83-c7a1-4eee-88d3-09dfcca73df2 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.592086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.593080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.593579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.593852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.594558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.594827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.596251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.613051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 405/813] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.614001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.686317 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.713346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2fc83-c7a1-4eee-88d3-09dfcca73df2 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.730417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d111d-e3b9-41eb-a57d-3b23f1be8227 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.756074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.756676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.756954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.757229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.757918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.758223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.759578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45de8a-2c8f-488b-a5a0-e0c2b22162cf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.763277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.771085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.771703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.772052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.772520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.773659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] RBAC: Adding query filter params (name=network) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:20.774116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.775505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.780493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 409/814] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.780743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 406/815] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:20.781799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.782181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.782349 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.785694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.803589 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:20.804716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:20.878129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 410/816] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:20.879084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:20.903842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee265-e3ee-4ca1-b249-24e15d2e1441 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:20.945913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:20.946870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:20.947167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:20.947444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:20.957102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:20.958379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:20.960334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:20.976736 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:20.977747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:20.978638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:20.981409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 407/817] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:20.982488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.002952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e27259-f949-40f8-913d-7c4a3542b24a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.051243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.052392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.052945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.053490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.054402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.065050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.066989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:21.083790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:21.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:21.085812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:21.088125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 411/818] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:21.089150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.104000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a14b-b58a-4b6a-be60-fc6a9401e431 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.140901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.141611 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.142005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.142383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.143203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] RBAC: Adding query filter params (type=network) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:21.143613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.145144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.155749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 408/819] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.155749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.211027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb62-3d04-47ef-bdc8-b90581f74c3b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.237517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.248660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.249330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.249609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.249877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.251062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:21.251364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.253090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.263597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aeaba-7a82-4130-8aa8-0b8bdf00ad7e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.270268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 412/820] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.270268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.287286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.306046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.306581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.306862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.307135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.307863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:21.308174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.310194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.327852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 409/821] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.328675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.379182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66fa0d-4a6d-487a-adf8-1a079790eaa3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.422545 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.423149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.423429 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.423720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.424477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.425879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.436401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4553c-a692-4ff3-a888-b8802147afb4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.457284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 413/822] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:21.457284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.496907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.497581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.497857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.498131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.498724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.500221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.509108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:21.514888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:21.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:21.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 410/823] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:21.519482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.577595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.583113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d298bd7-f186-47eb-9c19-b4aa1a4aff6d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.623661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.624437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.624842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.625211 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/b9311a16e8a3495093739c1ce7c1e66f/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.645746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=b9311a16e8a3495093739c1ce7c1e66f, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.647732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.663026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 414/824] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:21 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/b9311a16e8a3495093739c1ce7c1e66f/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:21.664160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.665433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e7d2a-4e7c-48e0-9b99-21d158ebba8a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.709524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.710466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.710867 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.711286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.724558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.726532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:21.745125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:21.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:21.747879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:21.747879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:21.747879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:21.748242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 411/825] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:21.757317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.805755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.821465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ff6b8-7d56-4b44-917d-76127200e843 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.873496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.874452 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.874931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.875396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.876269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:21.876784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.879035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.889042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 415/826] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.891998 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:21.898389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.916947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579bb7c-f341-4c01-a9fe-5dad5ecd0c44 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:21.959998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817859-5796-44da-b115-47b89b314416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:21.961111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817859-5796-44da-b115-47b89b314416 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.961553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817859-5796-44da-b115-47b89b314416 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.961969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817859-5796-44da-b115-47b89b314416 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.963467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9817859-5796-44da-b115-47b89b314416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:21.963915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9817859-5796-44da-b115-47b89b314416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:21.966253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9817859-5796-44da-b115-47b89b314416 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:21.987433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 412/827] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.989542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817859-5796-44da-b115-47b89b314416 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.012897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4653d0-5907-4e4d-9c24-515b58626c7c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.055329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.055934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.056209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.056477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.057108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:22.057453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.058833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.069484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 416/828] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:22.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.097573 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.120353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817859-5796-44da-b115-47b89b314416 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.170037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.171688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.172465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.172945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.179955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aa41e-189d-4c59-928a-e2bd94db99cd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.183752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.186459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:22.203292 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:22.204308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:22.205201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 413/829] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:22.214084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.226475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.226818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.228112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.228395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.228673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.229466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.232207 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.255553 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 417/830] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:22.348176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f20fc3-cebf-48ae-99f4-b40bd3a22e16 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.393319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.393935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.394210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.394476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.395174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:22.395521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.396964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418057d0-64ca-4cc9-84a6-5aad1d11df7b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.421361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 414/831] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:22.427235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.515163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.539053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bbdc-bcc7-43f0-ae09-61abd0206859 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.573151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.573825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.574098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.574440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/bf7c613ffbc6445296b63c1083ac8357/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.576311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=bf7c613ffbc6445296b63c1083ac8357, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.577770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51e39b-6187-4e44-b059-97dd46299fad None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.594528 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 418/832] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:22 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/bf7c613ffbc6445296b63c1083ac8357/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:26:22.842094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cb5be-d29c-463d-aeae-0e78cecc9ce9 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.842620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cb5be-d29c-463d-aeae-0e78cecc9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.842973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cb5be-d29c-463d-aeae-0e78cecc9ce9 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.844743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 415/833] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:22.849721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.850116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.850262 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.868391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:22.869581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:22.935719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 419/834] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:23.205370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cb5be-d29c-463d-aeae-0e78cecc9ce9 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.271392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.314544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cb5be-d29c-463d-aeae-0e78cecc9ce9 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.349177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.349831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.350111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.350970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.352339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:23.361240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:23.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:23.365454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 416/835] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:23.369276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.446973 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.481074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5ba8-b6a6-4f4b-9cec-60a6035f92ea None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.516347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.516970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.517246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.517536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.518196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:23.518494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.519900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db979c-ba1a-47ad-9a28-67d3fa679167 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.525757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 420/836] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.531066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.636352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760effb-ab04-4a13-9e4c-dba8bcf7665c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.663730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.672408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.673232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.673705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.673976 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.674601 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:23.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.676251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec400b3-b5f4-4047-bb31-fd367a28a2f5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.680906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 417/837] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.073680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86022e-6417-4cdf-beb2-292f2a4f1f56 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.074471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86022e-6417-4cdf-beb2-292f2a4f1f56 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.074471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86022e-6417-4cdf-beb2-292f2a4f1f56 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.075907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 421/838] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:24.081099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c2780-c3ee-4bb8-82fb-b689c02c596d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.081617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c2780-c3ee-4bb8-82fb-b689c02c596d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.081772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c2780-c3ee-4bb8-82fb-b689c02c596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.103773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-406c2780-c3ee-4bb8-82fb-b689c02c596d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:24.104953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-406c2780-c3ee-4bb8-82fb-b689c02c596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:24.180326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 418/839] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:24.459131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86022e-6417-4cdf-beb2-292f2a4f1f56 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.528953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8963a-48b3-4ffd-8dbb-95bcd9239bbe None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.528953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8963a-48b3-4ffd-8dbb-95bcd9239bbe None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.528953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8963a-48b3-4ffd-8dbb-95bcd9239bbe None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.528953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 419/840] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:24.537870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.537870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.537870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.555565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:24.557058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:24.565805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86022e-6417-4cdf-beb2-292f2a4f1f56 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.604497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.610638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.611538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.612405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.612827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.626581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:24.633125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:24.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:24.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:24.637919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 422/841] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:24.643406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.649320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 420/842] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:24.759024 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652a19-5609-418c-88a2-2a5232e3d259 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.799416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.800367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.800847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.801342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.802231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:24.802730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.804291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4912f3-a7a5-4ee9-9ca4-56fda613809d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.813810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 423/843] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.819786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.870091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bc18-1142-4db5-a5e7-92914ab3b195 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.870423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bc18-1142-4db5-a5e7-92914ab3b195 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.870640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bc18-1142-4db5-a5e7-92914ab3b195 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.872242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 424/844] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:24.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.878362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.878616 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.880001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.901162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:24.902930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:24.936462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197f58d-1459-4c46-9003-ab08a815eda3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.963206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.975222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.975851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.976132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.976412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.981993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 425/845] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:24.986126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.987226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.988668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:25.004543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:25.005551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:25.006431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:25.006431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:25.006431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:25.011139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 421/846] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:25.012508 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.102484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f22d34-443f-4f03-9dd1-e5f6ec3c685c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.116354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0d673-1ac7-4a6f-b8a2-bd902aba3ac9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.118705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.145009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.146414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.146996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.147459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.148239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.149793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.154013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.154731 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.155084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.155428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.156143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.156516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.157999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:25.161548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:25.162524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:25.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:25.171959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 426/847] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:25.173531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.176179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 422/848] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:25.181184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.228458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.288447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1dea-acca-4a02-b7f1-140ee53dfbe0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.288627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f384-4198-4ba9-b01d-30f15503cd59 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.326436 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.327337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.327735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.327935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.328217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.328495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.328845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.329132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.329474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.329720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.330826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.335920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 427/849] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:25.336705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.341784 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.343332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:25.356622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:25.357821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:25.358811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 423/850] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:25.359394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.385720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.456947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75b2f1-f9a6-4627-b329-3468a04a87b1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.465749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1e26-2130-4383-b3ed-d911379b99ee None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.472299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.495958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.497106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.497406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.497699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.501592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.502358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.502813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.503086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.503743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.504009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.505391 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.508433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:25.510335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 424/851] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:25.511270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:25.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:25.515543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:25.516472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:25.520829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 428/852] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:25.521709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.638933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb279-82cf-4307-b5ad-3479ae075091 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.658815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.676116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fc447-735f-4340-82c9-3ccd79f801e6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.678278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.679041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.679326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.679598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.680280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.680586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.682002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.697075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 429/853] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:25.698285 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.726634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.727642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.727922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.728195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.728930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.729235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.731248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.739886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.756215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 425/854] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:25.762579 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.826967 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8532d6-9ec3-45fc-ab82-4731272f60db None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.870004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.870688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.870976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.871354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.872694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3fca8-1bca-46cc-add8-8b4f881f760c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.884391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.886214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-23b39a2a-b0a1-459a-87ef-89bb252889ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:25.902220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:25.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:25.904678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:25.904678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:25.904678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:25.904678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 430/855] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:25.905396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3bda-c2ac-4171-9794-a40152b703cf None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.905496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3bda-c2ac-4171-9794-a40152b703cf None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.905803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3bda-c2ac-4171-9794-a40152b703cf None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.907082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 431/856] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:25.910318 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3bda-c2ac-4171-9794-a40152b703cf None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.915417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.916030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.916308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.916581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.933063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.989230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.990700 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.005078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.023357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3bda-c2ac-4171-9794-a40152b703cf None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.059760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.060365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.060642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.060913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.061582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:26.061882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.063237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670add5c-c67a-4ed6-b74f-10a65176781c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.075969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 432/857] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:26.080519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.080519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.080519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.096564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:26.098072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:26.104159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 426/858] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:26:26.104159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.153469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.173155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 433/859] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:26.174646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.218039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd7a1-b3c4-45dd-8b91-7d9cd79a7568 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.264774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.265705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.266124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.266531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.270943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.280221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.281723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:26.294041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:26.295013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:26:26.295947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:26.300032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 427/860] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:26.301199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.303074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba2d6d-9ef1-4c6d-9050-55abf85e2a75 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.352491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.353988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.354448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.354891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.369645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.372515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:26.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:26.393505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:26.394397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:26.394397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:26.394397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:26.396862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 434/861] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:26.407935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.411831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d607-e902-4cf2-8656-321df693eafa None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.419559 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.450154 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.450929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.451371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.451956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.453045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:26.453498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.456076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.476416 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 428/862] 10.222.0.25 () {56 vars in 1135 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:26.477413 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.533114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364a1b-6774-4f4d-b78e-924fc9c9712c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.561740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.570643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.571236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.571510 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.571918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.572574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:26.572895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.574672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.579194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f004-f3c9-40bb-9e2f-854730435730 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.589314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 435/863] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:26.589314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.619740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.620451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.620737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.621025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.621742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.623091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.639035 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 429/864] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:26 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:26.639887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.687874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.720393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ea89-e0c6-46c1-90ee-e6b72afb7f06 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.776889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.777612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.777892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.778162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.799093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66ad8-b647-45d6-8926-e9a9636a912a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.838169 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:26.838169 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:26.838460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:26.838722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:26.848348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.849967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.852223 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:26.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:26.864605 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:26.865556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 430/865] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:26.870580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:26.881372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:26.881770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:26.969696 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:26.985731 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bec95-246d-4ff8-8bde-bf3f3aefc709 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:26.989162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 436/866] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:26.990409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.035094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.036118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.036963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.037692 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.038058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.040370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.061352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 431/867] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:27.066033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.084845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.104083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca26d-f159-4557-be10-04b625511ffc None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.140617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.141374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.141723 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.142066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.154578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.156108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:27.171629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:27.172578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:27.173914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:27.173914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:27.173914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:27.173914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 437/868] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:27.178978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.200430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0af54-0077-4e86-873c-4e466de32ff5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.244097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.245249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.245722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.246946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.248249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=b9311a16e8a3495093739c1ce7c1e66f) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.248967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.251208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.259448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 432/869] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/role_assignments?user.id=b9311a16e8a3495093739c1ce7c1e66f&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:27.303523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb3f21-17f3-4ea6-aa83-75e61c486236 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.342683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.343713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.344167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.344657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.345558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.346036 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.347582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.350713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.364121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 438/870] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:27.370494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.382905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.484842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76735f-b58f-4a0a-a894-466c42b82b44 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.520772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.522619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.522619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.522619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.531379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.532843 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:27.545375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:27.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:27.547484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 433/871] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:27.554194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.671067 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e9f7e-a2ed-40dd-862e-cf705238009e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.706092 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.706687 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.706964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.707232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.707929 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.708232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.709676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5ea5c-725e-4e86-827b-b6b9ad1cafa7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.727238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 439/872] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:27.728578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.754276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fbea-b91a-4cfc-8b1a-913e7330be09 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.754571 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fbea-b91a-4cfc-8b1a-913e7330be09 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.754825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fbea-b91a-4cfc-8b1a-913e7330be09 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.757233 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 440/873] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:27.762590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.762867 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.763257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.784773 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:27.786035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:27.803916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.848015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109f27-bb62-43f0-8954-81f40a6ad693 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.856649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.881289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 441/874] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:27.895547 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.896152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.896431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.896701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.897888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=bf7c613ffbc6445296b63c1083ac8357) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.897888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.899251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2bfe-376e-4fa8-988a-d0b38cf98d24 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.913452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 434/875] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/role_assignments?user.id=bf7c613ffbc6445296b63c1083ac8357&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:28.149065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.257842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd857-fccc-4a53-aff8-e63d5c441b09 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.295526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.296526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.297063 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.297582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.298454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.300100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5380-bd60-4f5a-ae4e-704356c4c3a2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.319215 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 442/876] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:28 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:28.938465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d575d3-4832-4f09-aa98-e5a0334082b4 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.938986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d575d3-4832-4f09-aa98-e5a0334082b4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.938986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d575d3-4832-4f09-aa98-e5a0334082b4 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.940548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 435/877] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:28.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.946104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.946376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.967178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:28.968366 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:29.012813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.047700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 443/878] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:29.310824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d575d3-4832-4f09-aa98-e5a0334082b4 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.419288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d575d3-4832-4f09-aa98-e5a0334082b4 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.450097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.455184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.456161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.456747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.457360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.457941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.459367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:29.468808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:29.469743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:29.470896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 436/879] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:29.476042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.582636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be948102-e7b1-42a6-98d8-4cd5f05ca4fc None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.617895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.618502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.618783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.619057 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.619699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:29.620039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.621493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c72af-cec6-4ddf-a185-8581ad834c37 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.626735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 444/880] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.632255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.672312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b66d-9c75-465d-9ded-41e9ccd47136 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.672939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b66d-9c75-465d-9ded-41e9ccd47136 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.673607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b66d-9c75-465d-9ded-41e9ccd47136 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.676248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 445/881] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:29.682309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.682824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.683327 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.703825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:29.705027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:29.750820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d9bb-65ce-4de0-8fbc-81c65030ef8a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.765634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.781295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 446/882] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:29.797966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.798781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.799237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.799657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.800442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:29.800890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.802489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.808039 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 437/883] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.813693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.919643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e030-9376-4fc7-ad1e-0ca784504057 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.954950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.955546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.955818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.956086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.956840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] RBAC: Adding query filter params (interface=public, service_id=738e60114b314f75a1efe396a47325df, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:29.957142 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.964001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 447/884] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/endpoints?service_id=738e60114b314f75a1efe396a47325df&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.970256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.032956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.083290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.090786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7579b-ca17-473e-bacb-9612666e593a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.115240 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.130257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.130780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.131086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.131364 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.132042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.133720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab99db-5219-49f0-aa16-296b5a3686dc None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.146562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 438/885] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:30.171280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491504a-b2d4-47d8-a77c-297150104775 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.171570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491504a-b2d4-47d8-a77c-297150104775 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.171810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491504a-b2d4-47d8-a77c-297150104775 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.173597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 439/886] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:30.182460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.183052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.184008 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.204641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:30.206392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:30.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3840fc-7ebc-4729-bf43-f7b84be3aca3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.271010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.271758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.272064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.272370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.293321 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:30.296316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:30.297271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:30.298265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 448/887] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:30.299213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 440/888] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:30.303444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.405555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.426872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e26a-092b-4355-900b-e3d99f0403b3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.470438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.471085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.471384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.471695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.472449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:30.472804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.474369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47da884-bcc9-482c-8d33-4b3398fc2735 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.484655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 449/889] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.490038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.548379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745f30-cb4a-4471-8a99-f4a5575a894e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.550745 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745f30-cb4a-4471-8a99-f4a5575a894e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.551261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745f30-cb4a-4471-8a99-f4a5575a894e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.553039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 450/890] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:30.558179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.558721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.559194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.578200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:30.579624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:30.595452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52b020-d1c6-43c1-97ed-e0c72d54533f None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.631637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.632300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.632553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.632819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.642932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.644353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.657290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 451/891] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:30.657290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:30.662968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:30.663945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:30.664823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:30.664823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:30.664823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:30.669969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 441/892] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:30.671144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.766152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.789733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082169b-da3f-4113-b5ab-e57098ed7646 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.798276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ff04e-7562-4865-99db-0926877e8214 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.799829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.834924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.835767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.836177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.836799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.838078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:30.838636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.840885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.844299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.845150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.845622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.846059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.846798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.848296 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.862546 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 442/893] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:30.864180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:30.865419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:30.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:30.872001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 452/894] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:30.874911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.991542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74138-4d43-40c6-9a50-204f14d1d247 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.995411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80234cf-6341-4c9f-9645-48d82dd23f28 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.027356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.027907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.028189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.028460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.036502 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.036957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.037964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.038555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.039030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.039970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.040478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.042133 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 453/895] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:31.054344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:31.055237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 443/896] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:31.057002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.070274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.086931 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.166957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a789-22d3-415d-aafb-f445560508a0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.170853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f462dd3-38c6-4f5f-8d05-5e2d4ff64e92 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.201933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.202545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.202821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.203112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.203707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.204017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.205397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.207332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.207947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.208227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.208494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.209072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.210409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 444/897] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.210998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.217624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:31.233143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:31.234598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:31.235558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:31.243821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 454/898] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:31.245034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.327186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.338660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4999-6a26-4566-9a04-f99ecedad99b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.346630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.379173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.381038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.381038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.381038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.382056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.382056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.382890 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26c371-d2e7-4308-8721-202cd4c5c85c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.383320 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.412088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 445/899] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.414314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.431901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.432952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.434162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.434993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.436630 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.437124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.438674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.444065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 455/900] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.449716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.557530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2e44-538f-42c0-9ef9-88f9d776d8cd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.559550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590561-ac58-4839-be8e-6ee5c9ed3cf8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.595005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.595530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.595808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.596082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.596746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.597021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.598428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.603968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.604916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.605465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.605938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.608676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 456/901] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:31.609560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.612284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.631386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.695238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.696784 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.720855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6fd3e-3397-426f-bd5a-2ccbd432aed3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.755842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.756879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.757404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.757889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.758803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] RBAC: Adding query filter params (interface=public, service_id=dbc0f1868122443eb86b4cbd2549ff9c, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.759333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.761155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.766912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 457/902] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/endpoints?service_id=dbc0f1868122443eb86b4cbd2549ff9c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.772201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.807954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 446/903] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:26:31.809399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.843274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.863893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.891462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8f07-7e24-472f-a455-a94d2a9eaaf7 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.927293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c4ecf-1e96-4f2e-a5ba-b230d40c83d6 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.931161 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.931994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.932486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.932962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.934450 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.936578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.943971 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 458/904] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:31.967690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.968338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.968610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.968879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.981530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.983063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:31.999873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:32.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:32.002765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:32.002765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:32.002765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:32.002765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 447/905] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:32.006742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.135595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f91f-14c2-4d09-a3e9-3ae3dd895933 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.166698 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:32.173030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.173742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.174014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.174280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.174919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:32.175212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:32.176552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:32.189480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 459/906] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:32.194656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.298199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:32.301532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7a8-76b5-41e3-9bf4-72fed8a3cf46 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.336774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.337447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.337991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.345445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:32.346963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:32.358588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:32.359532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:32.360424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 448/907] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:32.365565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.484037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9c7d-7e9b-488e-aa67-ea5d56552aec None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.519371 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.519965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.520310 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.520594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.521316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:32.521624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:32.523045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1ff5-4baa-4790-aa6b-bd4920b2c561 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:32.535871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 460/908] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:32.542324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.545093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505cb59-9fad-42cd-a5c9-80edf7c473c9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.545638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505cb59-9fad-42cd-a5c9-80edf7c473c9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.545920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505cb59-9fad-42cd-a5c9-80edf7c473c9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.548471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 461/909] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:32.553857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.554300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.554828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.574783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:32.575948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:32.624312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:32.656031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 462/910] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:32.658507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315191f-54f0-47cd-b47d-f7696614e035 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.693366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.694354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.694833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.695323 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.696255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] RBAC: Adding query filter params (role.id=a4c457636b384fb8a0019b9c5648cab7, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=b9311a16e8a3495093739c1ce7c1e66f) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:32.696758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:32.698499 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:32.705088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 449/911] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/role_assignments?user.id=b9311a16e8a3495093739c1ce7c1e66f&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a4c457636b384fb8a0019b9c5648cab7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:32.925793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.029353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098eb57-5f05-4ebc-af54-84386729e072 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.065627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.066252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.066586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.066864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.067453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.068811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:33.077752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:33.078718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:33.079609 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 463/912] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:33.084667 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.114999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.195672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba0b1c-22b9-4127-b024-0b7c45ae17a1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.231330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.231945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.232222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.232493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.233127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:33.233457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.234896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.240151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 450/913] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:33.246878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.294670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.354037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf01af-a4ae-41e0-8e7b-efa94311a7d2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.390747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.391351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.391627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.391900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.392536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:33.392838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.394225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6922f6-448f-4823-bbc2-ab4a7a9ba1e4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.399560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 464/914] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:33.406351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.415179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445ff76-0fb8-4fac-b205-23977fd02418 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.415304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445ff76-0fb8-4fac-b205-23977fd02418 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.415544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445ff76-0fb8-4fac-b205-23977fd02418 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.417117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 465/915] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:33.422803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.423086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.423359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.442251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:33.443562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:33.516606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.529324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 466/916] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:33.534541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2319fe-2dae-4d6d-ab17-b3ec4fa4ad55 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.569111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.570104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.570575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.571038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.571900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.573483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd81122-f941-481d-9977-886e1f57c910 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.596915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 451/917] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:33.799492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.840789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.903464 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e791cc-c1a1-4c1c-8e9f-647f0ef3ebfe None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.943430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.944032 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.944308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.944575 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.945233 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.946608 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083061d-2dfd-4a16-9739-ad58e12d01c7 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.962810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 467/918] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:33 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:34.307315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46df6-f0af-406c-9888-cf2ddde70917 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.307827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46df6-f0af-406c-9888-cf2ddde70917 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.307936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46df6-f0af-406c-9888-cf2ddde70917 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.309657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 452/919] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:34.315128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206d33-2075-4d04-9326-c25b4390683f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.315438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206d33-2075-4d04-9326-c25b4390683f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.315720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43206d33-2075-4d04-9326-c25b4390683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.334683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-43206d33-2075-4d04-9326-c25b4390683f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.335865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-43206d33-2075-4d04-9326-c25b4390683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:34.410990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 468/920] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:34.680094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46df6-f0af-406c-9888-cf2ddde70917 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:34.789943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46df6-f0af-406c-9888-cf2ddde70917 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:34.828404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:34.829427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.829901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.830390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.831159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:34.832721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-09527a1b-a0d9-442c-bb6f-bb5938d1be22 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:34.841820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:34.842790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:26:34.843615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:34.846255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 453/921] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:34.854620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43206d33-2075-4d04-9326-c25b4390683f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:34.876515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.908824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1290f4-25f8-430e-8c22-fe15e12fe1ec None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.909518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1290f4-25f8-430e-8c22-fe15e12fe1ec None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.909989 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1290f4-25f8-430e-8c22-fe15e12fe1ec None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.911870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 454/922] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:34.918747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.919353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.919828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.938217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.939792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:34.942005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.967514 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43206d33-2075-4d04-9326-c25b4390683f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.001987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.002586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.002863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.003133 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.003768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:35.004069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.005458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.010735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 469/923] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.016538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.018757 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 455/924] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:35.105517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.123507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8e23c-c00c-4787-b8d4-174d96ed0e25 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.157535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.158128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.158407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.158676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.159300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:35.159596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.160993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.166163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 470/925] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:35.172167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.274226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774afb-de21-4836-9717-e9b8a942fa64 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.312904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.316041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.316679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.316982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.317313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.318071 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.320688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.331691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.348191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 456/926] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:35.438293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee2a8-018d-4b7f-a7a9-87fa80c537c2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.483574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.484216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.484483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.484750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.498580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:35.503779 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:35.504846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:35.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 471/927] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:35.511760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.617740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6fe8-113a-47bc-a05d-043849e227d3 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.652840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.653740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.654662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:35.654955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.656306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.664713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 457/928] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.670307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.676347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.779080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a41b1-8001-4211-b468-1e2b92f525f1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.816302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.817289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.817744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.818397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.830336 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.832085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-f7238282-e497-46db-a6ad-74edea39a97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:35.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:35.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:35.851778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:35.851778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:35.851778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:35.853809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 472/929] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:35.861763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.919542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.966832 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72732b-ecc3-4b62-a514-fd25b23e7115 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.967376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72732b-ecc3-4b62-a514-fd25b23e7115 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.967376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72732b-ecc3-4b62-a514-fd25b23e7115 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.968797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 473/930] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:35.969249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47765-329f-487f-a6af-b2ce179853e4 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.974612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.975173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.975658 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.995554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:35.997362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:36.009074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.010289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.010767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.011248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.012263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.012734 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.014578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.029000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 458/931] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.034360 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.058150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.079602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 474/932] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:36.159874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225669-af6a-403e-88b0-463e371be564 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.179885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.200450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.201402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.201925 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.202375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.210045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.211679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-bf417ab1-61fe-4e72-9e62-14f336698175 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:36.223930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:36.224881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:36.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.227973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 459/933] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:36.237306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.265393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2e0a-40ac-47d0-9433-abd2ee4d0849 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.265764 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2e0a-40ac-47d0-9433-abd2ee4d0849 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.266030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2e0a-40ac-47d0-9433-abd2ee4d0849 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.267592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 460/934] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:36.272632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.272907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.273177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.294130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:36.295920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:36.361640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4d36-f656-4786-b4a4-c0c301a66f37 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.384979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 461/935] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:36.385885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.417304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.417304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.417304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.417304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.418237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.418237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.419834 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.442042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 475/936] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.447945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.502189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb19ba-ca2d-4cce-99f8-f9316cf4fa45 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.502743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.510851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.542160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.542878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.543190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.543484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.544252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.545892 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:36.555423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:36.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:36.557301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.561812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 462/937] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:36.562644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.574810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa483-e7b8-4467-b4c1-ffa9e3c12699 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.617131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2142-9075-4205-813c-da3e63865660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.618538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2142-9075-4205-813c-da3e63865660 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.619096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2142-9075-4205-813c-da3e63865660 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.619592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2142-9075-4205-813c-da3e63865660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.632469 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2142-9075-4205-813c-da3e63865660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.634185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2142-9075-4205-813c-da3e63865660 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-000b2142-9075-4205-813c-da3e63865660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:36.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:36.652884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:36.653822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:36.653822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:36.653822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:36.659404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 476/938] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:36.661151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2142-9075-4205-813c-da3e63865660 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.679583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727fa4-9def-4383-baf3-83cad4d42947 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.722684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.723280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.723589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.723892 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.724604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] RBAC: Adding query filter params (name=compute) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.724914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.726435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.732471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 463/939] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.733197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.766477 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.768761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.773468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2142-9075-4205-813c-da3e63865660 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.807378 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.808526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.808803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.809072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.809737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.810037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.811391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.822926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 477/940] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:36.823765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.845758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65405f-3854-41bb-add3-8094d439b6be None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.883429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.884144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.884447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.885017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.885698 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.887747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:36.897498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:36.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:36.899280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 464/941] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:36.900068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.940149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615a8a-6d12-49ea-b0d4-7a938aca7ec5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.976818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.977428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.977657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.977907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.978532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.978838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.980229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.993332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 478/942] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.993332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.017951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.020060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.024975 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7528-9cae-42da-a6c8-f9f9331d66be None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.065061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.066100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.066555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.067022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.075315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.077180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:37.089861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:37.090857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:37.091775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:37.093961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 465/943] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:37.100309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.127558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750eb1-6e80-4958-a6b4-c44691f543b3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.175416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.176485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.176995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.177500 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.178357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:37.178867 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.180471 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.186463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 479/944] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:37.192367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.228465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e2243-63e2-4b80-bf65-2d3b1d069911 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.264615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.265222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.265528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.265799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.266507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:37.266964 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.268226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.285286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 466/945] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:37.288492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.306769 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.316086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.318501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706904d-cfea-463c-a73b-4d8495819f64 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.363901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.364513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.364793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.365224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.365989 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:37.366294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.368320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.377334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 480/946] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:37.382153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.429338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78574a8-ac10-4d9e-a242-155cecfc024b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.472155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.472818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.473096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.474158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/b9311a16e8a3495093739c1ce7c1e66f/roles/a4c457636b384fb8a0019b9c5648cab7` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.476395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=b9311a16e8a3495093739c1ce7c1e66f, role_id=a4c457636b384fb8a0019b9c5648cab7)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.477899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.497440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 467/947] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:37 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/b9311a16e8a3495093739c1ce7c1e66f/roles/a4c457636b384fb8a0019b9c5648cab7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:37.516386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaa986-2e8e-46ba-bfa0-261cd0d3448c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.559851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.560579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.560864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.561140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.561935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] RBAC: Adding query filter params (interface=public, service_id=48aa4edac4d3494b914c024567310322, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:37.562297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.563937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfa764-301b-4da0-99a1-9cdfe4a7f5a0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.575709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 481/948] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/endpoints?service_id=48aa4edac4d3494b914c024567310322&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:37.577183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.665647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9790-f303-4c20-822a-4db2806f4091 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.665979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9790-f303-4c20-822a-4db2806f4091 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9790-f303-4c20-822a-4db2806f4091 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.669096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 482/949] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:37.669901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.677966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.678484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.678862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.704819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999852d0-c022-4e6c-a9a3-99c83c0447ff None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.706308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:37.707647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:37.716414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.748653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.749182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.749493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.749817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.750426 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.751818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.765314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 468/950] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:37.791060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 483/951] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:38.062608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.164703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722b1c-a200-4823-b4d3-3426aad4646a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.198817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.199410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.199683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.199949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.200591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.202038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.204612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING keystone.server.flask.common [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:26:38.219130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.223512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.sql.core [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:26:38.223512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:26:38.223512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [parameters: {'id': 'd515d7b649ae4f14b45346756d11abe3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:26:38.223512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81493) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d515d7b649ae4f14b45346756d11abe3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d515d7b649ae4f14b45346756d11abe3. Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:26:38.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result.read() Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 09:26:38.232489 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application yield resource Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise self.value Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application session.commit() Sep 30 09:26:38.233497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:26:38.234400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:26:38.235304 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application result.read() Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:26:38.236102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [parameters: {'id': 'd515d7b649ae4f14b45346756d11abe3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.236974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:38.237793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d515d7b649ae4f14b45346756d11abe3. Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:38.238712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 469/952] 10.222.0.25 () {60 vars in 1140 bytes} [Fri Sep 30 09:26:38 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:38.240602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.350614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0854-0a00-43ee-907f-9104e3325ef3 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.386719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.387344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.387616 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.387939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.394626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.396061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-38cf893d-70c1-455b-bf1f-6ebc0c37f3ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:38.409079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:38.410015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:38.410983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 484/953] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:38.415143 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.519132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c405-b74d-40cc-94d0-f484d7de855e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.553770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.554370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.554644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.554911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.555570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:38.555868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.557574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4583-5d85-41cd-a370-b5dce2d809a4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.582431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 470/954] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:39.232348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631c96-cd65-4e9d-a3e7-dbee6a608b04 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.232731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631c96-cd65-4e9d-a3e7-dbee6a608b04 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.232909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631c96-cd65-4e9d-a3e7-dbee6a608b04 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.234469 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 485/955] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:39.239875 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0050-e92f-425b-abf9-186724e9f614 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.240162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0050-e92f-425b-abf9-186724e9f614 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.240437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa0050-e92f-425b-abf9-186724e9f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.259010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-45fa0050-e92f-425b-abf9-186724e9f614 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:39.260764 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-45fa0050-e92f-425b-abf9-186724e9f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:39.316992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.332800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 471/956] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:39.598401 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01631c96-cd65-4e9d-a3e7-dbee6a608b04 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.601588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.708201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01631c96-cd65-4e9d-a3e7-dbee6a608b04 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.742283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.742885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.743158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.743423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.744088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.745988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05795c3a-9970-48d9-8903-d407c1be925c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.764720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 486/957] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:39 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:39.769612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e32dc-0de3-47c2-8934-d1fe87f2129d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.770533 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e32dc-0de3-47c2-8934-d1fe87f2129d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.771003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e32dc-0de3-47c2-8934-d1fe87f2129d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.772942 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 472/958] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:39.779628 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675255b-7ed9-4e8e-9dbf-519ff634c1f9 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.780280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675255b-7ed9-4e8e-9dbf-519ff634c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.780761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675255b-7ed9-4e8e-9dbf-519ff634c1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.804922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-6675255b-7ed9-4e8e-9dbf-519ff634c1f9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:39.806130 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6675255b-7ed9-4e8e-9dbf-519ff634c1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:39.871304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.890829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 487/959] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:40.040434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee10-e99b-4deb-aa3e-2612825debe8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.040760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee10-e99b-4deb-aa3e-2612825debe8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.041080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aee10-e99b-4deb-aa3e-2612825debe8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.042752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 473/960] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:40.048701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.048990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.049280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.067765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:40.068942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:40.137329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 488/961] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:40.169494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aee10-e99b-4deb-aa3e-2612825debe8 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.275778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aee10-e99b-4deb-aa3e-2612825debe8 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.314330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.314962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.315238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.315509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.326520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:40.331442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:40.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:40.333402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 474/962] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:40.338577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.441402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9f06-d669-4af2-baee-4c6b5bfd0e56 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.447686 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.464485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.483789 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.484401 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.484680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.484954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.485653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:40.485958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.487337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.501404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 489/963] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:40.502926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.505110 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.569756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8728-24b9-458d-90f4-ce0c5828460d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.612337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.612967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.613296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.614115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.615484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.624115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540eb82-dbf8-4342-9b53-94bc66a555fd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:40.624738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:40.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:40.631591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 475/964] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:40.632938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.669562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.670175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.670453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.670719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.686546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.688892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:40.709033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:40.710088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:40.711075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:40.711075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:40.711075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:40.713078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 490/965] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:40.719306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.757382 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.765773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d93f8-4f02-4d30-923d-24fe0c26efc0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.782810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.813912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.815121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.815563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.815977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.817059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:40.817562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.820083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.832568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 476/966] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:40.834119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.847222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5411e8-4153-4562-85dc-524f0852b6e0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.888166 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.889092 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.889689 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.890152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.891039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:40.891579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.894049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.909659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 491/967] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:40.915332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.950603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d797-df64-46b6-aa44-46c373c4e223 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.986367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.986968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.987242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.987509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.988125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:40.988429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.989807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ded81-0d11-447d-a347-f2a57c7cd0af None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.994387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 477/968] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:40.996094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7972f-ecaa-42d9-baac-0968348193e4 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.996373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7972f-ecaa-42d9-baac-0968348193e4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.996655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7972f-ecaa-42d9-baac-0968348193e4 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 478/969] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:41.004638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.004987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.005355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.024759 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:41.025990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:41.028306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.040372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10485a7-e942-4af0-a7a5-e62387c5d6ff None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.060887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.082505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.083213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.083503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.083836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.091542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.092987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.095041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 479/970] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:41.095745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:41.115279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:41.116228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:26:41.117156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.123994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 492/971] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:41.125265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.199557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09ea27-3093-44ba-9ba0-523d225e218f None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.234855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.235775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.236249 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.237201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.238215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.240156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.250298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb88f5-5929-4fe5-b524-55a4aabb672c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.277873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 480/972] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:41.300192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.300800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.301132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.301441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.302228 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:41.302537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.304100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.330881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 493/973] 10.222.0.25 () {56 vars in 1149 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:41.332317 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.363695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.370913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.382655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.480845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07819bc-972a-4af1-b128-9393a972df8e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.528871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116069dd-d8f7-45c8-b139-aa3a6897f957 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.529316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.529953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.530233 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.530500 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.567654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.568319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.568598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.568872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.569695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.571260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.574703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING keystone.server.flask.common [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:26:41.591750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.sql.core [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:26:41.591750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:26:41.591750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [parameters: {'user_id': '0588e36556734e78badf78c2dfbaec58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:26:41.591750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81494) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application result.read() Sep 30 09:26:41.610776 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:26:41.611713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application yield resource Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise self.value Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application session.commit() Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:26:41.612686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:26:41.613635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:26:41.614541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application result.read() Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:26:41.615389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [parameters: {'user_id': '0588e36556734e78badf78c2dfbaec58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:41.616311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 30 09:26:41.617118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.620851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 494/974] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 30 09:26:41 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:41.621778 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.621933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.622081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.651128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.700693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.732726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 481/975] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:41.734140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.742636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b069-abf2-4d8d-afba-e89105a6da07 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.781526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.782407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.782833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.783351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.791669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.794333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:41.807304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:41.808347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:26:41.809335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:41.816466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 495/976] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:41.817650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.837159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226319-98ab-4066-b28e-788660f93bfa None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.866564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.876953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.877791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.878165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.878534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.890887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.892626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:41.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:41.909638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:41.910816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:41.910816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:41.910816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:41.916649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 482/977] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:41.918542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.939502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807967a7-a27e-4d31-b744-fd18a8416151 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.970128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.981907 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.982537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.982820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.983205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.983788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:41.984331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.985532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9b702-33c6-460f-9924-3985d9307830 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.037359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 496/978] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.037550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9898f-8e3e-4daa-915c-cc50afa65815 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad4735-2487-4ba2-8873-a43f13cc3893 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad4735-2487-4ba2-8873-a43f13cc3893 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad4735-2487-4ba2-8873-a43f13cc3893 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 497/979] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.037650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.038090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.059488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:42.061080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:42.079725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.080516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.080893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.081395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.082160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.082567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.084102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.101788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 483/980] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.104090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.158233 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 498/981] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:42.171087 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.238561 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070d85-3673-4fab-ab46-9bae57467629 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.275594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.276245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.277070 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.277375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.284959 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.286460 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:42.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:42.299681 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:42.300560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:42.304571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 484/982] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:42.305952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.415108 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030f915-2c47-4ef1-9e45-01808f4d68aa None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.432387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.441762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.451241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.451841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.452111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.452380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.453072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.453411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.454885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.467016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 499/983] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.472974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.541359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.546677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261f58-c48e-4947-9eb6-1fb7674312b8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.576611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b468-35a2-408d-ab91-7518717bfd4b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.583669 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.584288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.584551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.584819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.585421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.586785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:42.596367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:42.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:42.598294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:42.602477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 485/984] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:42.603124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.615622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.616226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.616860 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.617133 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.617892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] RBAC: Adding query filter params (role.id=a4c457636b384fb8a0019b9c5648cab7, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=b9311a16e8a3495093739c1ce7c1e66f) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.618513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.619944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.625741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 500/985] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/role_assignments?user.id=b9311a16e8a3495093739c1ce7c1e66f&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a4c457636b384fb8a0019b9c5648cab7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:42.716558 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299e10-ba37-4ec9-9a61-144e5598a805 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.753389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.754266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.754691 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.755106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.755931 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.756376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.757923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.764192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 486/986] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:42.769699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.816138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.876287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9991928-b6d8-42b4-bb39-8dddd18afe9d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.910122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.910918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.911410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.911821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.912651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.913122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.914640 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.920557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 501/987] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.926074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.954641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.029506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed072-398f-4fa1-ae3f-9dbd2ec56436 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.063912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.064507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.064779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.065044 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.065773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] RBAC: Adding query filter params (interface=public, service_id=76c05ab444fb490ab18100f3f68d9be3, region_id=RegionOne) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:43.066089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.067429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74ae5-ca53-4ab2-b04f-46df6082ef13 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.075218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 487/988] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/endpoints?service_id=76c05ab444fb490ab18100f3f68d9be3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:43.080695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.181706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d0950-f50d-4cc8-8b61-086d3ead1954 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.183955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.217276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.218242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.218518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.218786 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.219390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.220735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b4fd-c43c-4ac4-802e-0e4fce6e8622 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.231591 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 502/989] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:26:43.572649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088975b-3390-49ff-b166-592413eb3806 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.573022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088975b-3390-49ff-b166-592413eb3806 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.573284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088975b-3390-49ff-b166-592413eb3806 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.574673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 488/990] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:43.579815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.580106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.580384 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.598944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:43.600126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:43.703336 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 503/991] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:43.970714 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088975b-3390-49ff-b166-592413eb3806 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.070517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.082009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088975b-3390-49ff-b166-592413eb3806 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.116187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.116842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.117428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.118025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.119406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:44.129218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:44.130258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:44.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:44.133593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 489/992] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:44.136620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.231592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.236388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e622c-1580-4946-a43a-ec58cd678df6 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.270012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.270610 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.270891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.271166 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.271797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:44.272100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.273483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.278862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 504/993] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:44.284464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.387083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215adc8e-b882-4bd0-b7b5-cc5896414281 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.427091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.427692 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.427965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.428230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.428962 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:44.429177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.430549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.435673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 490/994] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:44.441237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.542268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ca6e2-a1ca-4134-92a0-113aba713f7c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.576247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.576836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.577161 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.577506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.578157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] RBAC: Adding query filter params (interface=admin, service_id=48aa4edac4d3494b914c024567310322, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:44.578462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.579805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e191d37-604c-47ea-a159-4b594b08638b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.584975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 505/995] 10.222.0.25 () {56 vars in 1249 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/endpoints?service_id=48aa4edac4d3494b914c024567310322&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:44.590423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.609776 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.688816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475916bd-cfef-4dc3-bfd6-79ad3dd94e12 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.722829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.723475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.723748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.724013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.724628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.726050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efe39b-9b8e-4b3c-823a-8747535927e3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.733873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 491/996] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:44.840413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0346c-e8c8-40e1-a251-cf1870598f43 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.840770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0346c-e8c8-40e1-a251-cf1870598f43 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.840974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0346c-e8c8-40e1-a251-cf1870598f43 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.842538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 506/997] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:44.847957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.848237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.848507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.868139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:44.869389 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:44.941993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 492/998] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:45.207264 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0346c-e8c8-40e1-a251-cf1870598f43 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:45.236637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:45.316372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0346c-e8c8-40e1-a251-cf1870598f43 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:45.351309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:45.351927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.352203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.352474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] PATH_INFO: `/v3/services/image` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.353055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:45.354474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2fa250de-f307-4b0d-902b-2f1bacba25ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:45.363082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:45.364084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:45.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:45.369076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 507/999] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 30 09:26:45 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:45.370330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:45.385155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:45.408377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d258-6223-4c3f-b935-335b3d80c448 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.408939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d258-6223-4c3f-b935-335b3d80c448 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.409215 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d258-6223-4c3f-b935-335b3d80c448 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.411623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 508/1000] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:45.417338 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.417658 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.417935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.436424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:45.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:45.485215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5eb85-f53e-4618-bd1a-6d9dd29da80d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:45.509733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 509/1001] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:45.522018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:45.522618 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.522895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.523164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.523791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:45.524091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:45.525469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:45.534996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 493/1002] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:45.535949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:45.558035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:45.637157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c5f8-b25b-4d6a-b002-be9373b0bda7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:45.671663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:45.672455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.672902 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.673352 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.674176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] RBAC: Adding query filter params (type=image) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:45.674676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:45.676160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:45.680618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 510/1003] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:45.780970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:45.866156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:45.889806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc80b-8a64-4b16-bcef-3029a1957bd9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:45.924053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:45.924673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.924948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.925217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.925820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:45.927180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:45.935876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:45.936833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:45.937701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 494/1004] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:45.943096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.027083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.043912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa684d-2e24-4109-be29-c44389843148 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.078526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.079122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.079396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.079663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.080287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:46.080584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:46.081966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:46.091721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 511/1005] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:46.092852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.189894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed2ef-8b4b-454a-8582-15312aa5837b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.223080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.223676 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.223948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.224213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.224830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:46.225125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:46.226514 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96992e8-29d2-49a7-b999-562df18c94c4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:46.231985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 495/1006] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 30 09:26:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:46.237463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.335269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5ac34-1183-4230-922b-df6b27f9068b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.368513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.369110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.370961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.370961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.370961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:46.372232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711abc-796c-440b-8537-e89eef84b09d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:46.392922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 512/1007] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:46.936486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ca6a-ca9e-4e86-9c60-a7921e4955b8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.937006 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ca6a-ca9e-4e86-9c60-a7921e4955b8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.937006 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ca6a-ca9e-4e86-9c60-a7921e4955b8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.938446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 496/1008] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:46.944434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.944755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.945134 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.953058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.966319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:46.967503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:47.045009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 513/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:46 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:47.310461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ca6a-ca9e-4e86-9c60-a7921e4955b8 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.314319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.423279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ca6a-ca9e-4e86-9c60-a7921e4955b8 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.456358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.456977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.457247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.457538 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.458112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.459455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:47.468631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:47.469675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:26:47.470531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:47.473326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 497/1010] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:47.475670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.574044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c161460-ef69-4589-b8de-20a68225cf78 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.601746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.609232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.609849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.610123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.610389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.611013 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:47.611309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.612661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.622189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 514/1011] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:47.623734 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.689932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.724555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5baa8b-f405-406d-b9ca-343aeaba78ee None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.762689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.763296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.763570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.763839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:47.764775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.766160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c6e2-d2f2-4d4e-95e2-831a99a09be5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.775932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 498/1012] 10.222.0.25 () {56 vars in 1122 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:47.777515 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.852872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ffece-2ec6-4b61-8708-06941192d457 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.853062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ffece-2ec6-4b61-8708-06941192d457 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.853418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ffece-2ec6-4b61-8708-06941192d457 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.855370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 499/1013] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:47.859982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c778-fcf3-401e-81de-6d28a8cd41a7 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.860266 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c778-fcf3-401e-81de-6d28a8cd41a7 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.860545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c778-fcf3-401e-81de-6d28a8cd41a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.878022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46415-fa78-454b-ad02-402513a685ad None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.878735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1430c778-fcf3-401e-81de-6d28a8cd41a7 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:47.879901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1430c778-fcf3-401e-81de-6d28a8cd41a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:47.913604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.914195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.914472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.914741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.915415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.917315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.933513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 515/1014] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:47.965512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 500/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:47 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:48.234877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.292935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.341041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61491-3e8c-4a8c-971a-3a966e145bb8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.375080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.375668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.375943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.376209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.376865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.378250 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966acde-ca16-489e-8bf2-9d287c48a044 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.397293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 516/1016] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:48 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:48.643730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a85-0fa6-473b-bf2b-bf0484aa8270 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.644128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a85-0fa6-473b-bf2b-bf0484aa8270 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.644308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a85-0fa6-473b-bf2b-bf0484aa8270 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.645788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 501/1017] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:48.650814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.651821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.651964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.670724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:48.671908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:48.747601 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 517/1018] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:49.014160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07a85-0fa6-473b-bf2b-bf0484aa8270 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.079059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.122813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07a85-0fa6-473b-bf2b-bf0484aa8270 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.157610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.158155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.158947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.158947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.173910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:49.178661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:49.179616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:49.180485 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:49.181820 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 502/1019] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:49.185667 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.227474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.286733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2990d6-2754-4f41-a0c0-b87945d2cec1 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.322377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.323529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.323809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.324078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.324806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:49.325109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.326532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.339578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 518/1020] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:49.340771 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.447832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dae30-5c38-48cb-baf9-f42c5bc50015 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.465306 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.483167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.483792 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.484072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.484345 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.494159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.495666 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:49.510510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:49.511497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:49.512498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:49.512498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:49.512498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:49.512498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 503/1021] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:49.518481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.622662 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814675-cc06-4786-ae47-a5b367e05f3a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.624203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.657732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.658390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.658601 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.658870 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.659519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:49.659825 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.661177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.673754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 519/1022] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:49.679158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.780269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbed1-5b98-4ffc-adce-1dd2af2df328 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.813479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.814102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.814382 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.814659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.821855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.823847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:49.834874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:49.835806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:49.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:49.842132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 504/1023] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:49.842258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.944247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f19b-b2dc-46e3-a442-de5fbb38ecd2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.978199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.979593 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.980054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.980502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.981430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:49.981950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.983543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1673f7-03e4-48c3-8b7d-db2c86ac267a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.002707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 520/1024] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:50.008967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.045865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.121117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3f33a-2d74-41ef-a6e4-fb4b2d2112d0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.122122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71da1-fa6e-4f89-8052-c0a792d4a7ad None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.122408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71da1-fa6e-4f89-8052-c0a792d4a7ad None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.122685 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71da1-fa6e-4f89-8052-c0a792d4a7ad None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.124036 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 521/1025] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:50.129269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.129562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.129837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.147966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:50.149147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:50.155229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.155835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.156110 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.156378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.164246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.220369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 522/1026] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:50.233434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.235141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.264673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.348539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 505/1027] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:26:50.355058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.467636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ada6c-1faf-4419-9386-1a0b2978e67e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.492672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.506749 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.507376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.507915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.508191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.522434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.523932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:50.540375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:50.541393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:50.546855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:50.546855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:50.546855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:50.546855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 523/1028] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:50.547845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.550800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.601657 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287a98-c4df-4f87-b203-8630f8610844 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.630041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.638206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.638837 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.639114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.639393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.640491 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.641960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bda22-e0fc-4b43-bd91-077a32f72988 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.643528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 506/1029] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:50.644656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be2cf-4973-43da-a0db-1ff3f993fe39 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.644939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be2cf-4973-43da-a0db-1ff3f993fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.645213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be2cf-4973-43da-a0db-1ff3f993fe39 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.646419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 507/1030] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:50.649078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4be2cf-4973-43da-a0db-1ff3f993fe39 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.660363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262ef8-e591-409e-a951-3c6a1f11fbe6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.694759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.695354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.695636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.695904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.696540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:50.696837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.698261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0987-149d-4adf-b88e-f0e2922f52c1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.710259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 524/1031] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:50.711395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.711680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.711953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.728708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:50.730447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:50.750229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4be2cf-4973-43da-a0db-1ff3f993fe39 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.782706 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.783581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.783854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.784507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.785961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.786383 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.797863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 525/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:50.798664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.817664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 508/1033] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:50 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:50.912807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed31f-fadb-44b3-9381-991900dc475d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.949952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.950599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.950880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.951154 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.959573 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.962306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:50.975548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:50.976676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:50.978087 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:50.981627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 526/1034] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:50.983198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.043677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.078017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.103394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2188ec-284f-44e1-979c-89f943945a14 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.136627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.140090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.140840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.141324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.141448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.142090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.142383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.143889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.156733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 509/1035] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.162373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.189224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57678-e633-45e0-86c6-524badcbf686 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.225633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.226261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.226539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.226808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.227399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.228747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:51.239625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:51.240722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:51.242560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 527/1036] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:51.246843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.271021 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad669-4407-456a-b29f-90df7074ba3c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.284527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.311171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.311694 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.311963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.312229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.312944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] RBAC: Adding query filter params (role.id=a4c457636b384fb8a0019b9c5648cab7, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.313243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.314682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.325205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 510/1037] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a4c457636b384fb8a0019b9c5648cab7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:51.356157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b816e6-dc43-4de2-8670-9a34034b4ee9 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.375594 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.396434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.397104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.397410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.397750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.398405 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] RBAC: Adding query filter params (name=image) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.398701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.400090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.410810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 528/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:51.416171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.525440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a034-a5b7-48f2-88ff-1d71a43dce8f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.559512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.560110 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.560386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.560653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.561343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.561591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.562937 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.572439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 511/1039] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.574248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.676286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271569f6-3ffd-4210-a3a1-5e91cf853880 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.710174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.710760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.711037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.711306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.711999 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] RBAC: Adding query filter params (interface=public, service_id=abca1d6b31dd42059c41b3da7b4c09c6, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.712305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.714284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f7768-2274-4a00-b3a1-03b16330c1c8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.723824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 529/1040] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/endpoints?service_id=abca1d6b31dd42059c41b3da7b4c09c6&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.725190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.768261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.831176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685207-2f34-4e3d-b54d-697efab24ce1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.863661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.864257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.864532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.864800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.865431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.866788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd691fd8-da12-4615-a511-03eb15984763 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.873935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 512/1041] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:53.023649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516c2-43b6-4516-9939-250915f3a5c5 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.024198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516c2-43b6-4516-9939-250915f3a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.024619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516c2-43b6-4516-9939-250915f3a5c5 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.029301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 530/1042] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:53.032727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250471-336c-4445-8b63-83275ca29105 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.033142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250471-336c-4445-8b63-83275ca29105 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.033329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250471-336c-4445-8b63-83275ca29105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.052130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2b250471-336c-4445-8b63-83275ca29105 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:53.053332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2b250471-336c-4445-8b63-83275ca29105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:53.122239 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 513/1043] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:53.389381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726516c2-43b6-4516-9939-250915f3a5c5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.438030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.447036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ba6-117b-4812-8f7a-06ca7e14eb80 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.447322 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ba6-117b-4812-8f7a-06ca7e14eb80 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.448227 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ba6-117b-4812-8f7a-06ca7e14eb80 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.453326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 514/1044] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:53.454784 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.455063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.455335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.473933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:53.475111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:53.499814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726516c2-43b6-4516-9939-250915f3a5c5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.501517 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.537058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.537715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.537984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.538252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.539357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.540796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.543172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 531/1045] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:53.545298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 515/1046] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:53.548566 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.648924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c258-a144-40be-8a4d-3f2ed66753cf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.661833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.684729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.685359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.685638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.685909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.686554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.687960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.710905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 532/1047] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:53 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:53.812293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.917940 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56dce-a9a9-46b3-863e-e688f0cd6809 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.955660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.956302 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.956575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.956842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.968777 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-c8bfd3f4-42cd-47af-a1c6-d88a7f454c3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:53.973597 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:53.974539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:53.975399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:53.977339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 516/1048] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:53.980901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.062913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f05f-4d5d-42f0-8e95-75866f15fc49 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.063434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f05f-4d5d-42f0-8e95-75866f15fc49 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.063434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f05f-4d5d-42f0-8e95-75866f15fc49 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.065490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 517/1049] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:54.070604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.070893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.071164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.083673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2796-b5af-4e5f-a277-76a568ac29d8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.089828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:54.091010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:54.109608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.119822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.120427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.120706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.120979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.121711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.122016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.123379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.136935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 533/1050] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:54.138828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.165357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 518/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:54.171852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.243893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efce8b-bc3c-4433-9eac-874c4eeb7e01 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.278604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.279509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.279924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.280347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.290958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.292645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:54.306637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.308137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:54.313917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:54.313917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:54.313917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:54.313917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 534/1052] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:54.315806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.417369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d08485-18ae-48e9-9f84-95cdbbf77b7d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.450385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.452641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.453247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.453546 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.453817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.454472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.454859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.456214 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.469305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 519/1053] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:54.474059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.489183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.542888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.563107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9a4f-dee1-4181-aff0-174d4ddd6390 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.585114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da6e4-8f39-4c4b-a509-e4fb8ea4d393 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.600082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.600845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.601122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.601438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] PATH_INFO: `/v3/services/image` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.602186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.604345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.613359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.614351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:54.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 535/1054] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:54.620657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.621839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.622471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.622748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.623018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.631232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.632680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:54.645437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:54.647437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 520/1055] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:54.653483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.728684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.732410 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b715ba2-e850-4cc1-a87f-e6fa2c911635 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.761986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd1747-6709-4901-b5f9-9e101308dd4c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.769132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.769766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.770047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.770316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.771297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] RBAC: Adding query filter params (name=image) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.771598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.773281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.783115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 536/1056] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:54.783949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.794991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.795581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.795858 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.796130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.796851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.797066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.797168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.798630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.816810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 521/1057] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:54.822341 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.895598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfef16-5c01-4b12-a962-946399942443 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.924385 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c724b23-dac4-48fc-b35b-cbc103631b21 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.930947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.931547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.932342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.932633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.933274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] RBAC: Adding query filter params (type=image) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.933575 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.934919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.945547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 537/1058] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:54.946423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.954575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.961649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.962283 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.962559 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.962828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.973235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.974604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:54.989074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.990050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:54.996230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:54.996230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:54.996230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:54.996230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 522/1059] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:54.997803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.027826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.060305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810ee60-816c-405c-ae98-a683581bf955 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.099382 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.100018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.100244 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.100511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.101172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.102551 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.109134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab548-f34d-4e32-87f1-8868d43c755b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.129444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 538/1060] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:55.164446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.165161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.165549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.165890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.167141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:55.167506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.168894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.182982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 523/1061] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:55.188577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.295481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6de438-d4e9-42b6-8347-d80b911f36c3 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.325409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.333425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.334312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.334596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.334869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.341738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.343174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:55.354980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:55.355884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:55.356878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 539/1062] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:55.362138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.412108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.470915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea4bf-fc9b-49b5-ae1d-0180868d2737 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.504548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.505156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.505458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.505733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.506423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:55.506725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.508155 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ed51-d4dd-493c-a561-88e02b493ed4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.520670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 524/1063] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:55.526509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.627141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff526b-d308-4b4f-a42d-3cf9738f502c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.660863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.661540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.661817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.662086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/a4c457636b384fb8a0019b9c5648cab7` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.664243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=1ae0aa2cf16f420db7bcb87d4d995901, role_id=a4c457636b384fb8a0019b9c5648cab7)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.665695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7345e-e39d-4dbd-ba4e-ed2986cd2855 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.679775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 540/1064] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:55 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/1ae0aa2cf16f420db7bcb87d4d995901/roles/a4c457636b384fb8a0019b9c5648cab7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:55.948655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904fa6-3bdf-4df5-a95d-3857aa092caa None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.948948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904fa6-3bdf-4df5-a95d-3857aa092caa None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.949130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904fa6-3bdf-4df5-a95d-3857aa092caa None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.950658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 525/1065] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:55.955760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.956231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.956510 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.975186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:55.976354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:56.025088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.051841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 541/1066] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:56.321656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904fa6-3bdf-4df5-a95d-3857aa092caa None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.425749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.431577 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904fa6-3bdf-4df5-a95d-3857aa092caa None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.468141 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.468768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.469043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.469336 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.479532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:56.484285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:56.485191 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:56.486325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:56.487394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 526/1067] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:56.491354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.592641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818750-6c13-40b8-8772-0cb1ca25301d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.626106 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.626697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.626975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.627245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.627901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:56.628201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:56.629659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:56.638307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 542/1068] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:56.644012 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.743415 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b4100-f0e7-4862-9024-326af1d79079 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.777690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.778315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.778648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.778925 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] PATH_INFO: `/v3/users/0a293d7813fc4f719f2d5ce8253dacd9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.792733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] RBAC: Authorizing `identity:get_user(user_id=0a293d7813fc4f719f2d5ce8253dacd9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:56.794204 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:56.800487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 527/1069] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/users/0a293d7813fc4f719f2d5ce8253dacd9 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:56.801710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.846230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.906619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8abb8b-82e3-4ce0-a2ce-92a47c71dacd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.940730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.941007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.941297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.007854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.009579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.052629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.112045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 543/1070] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:57.117641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.137177 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.221009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1d82-c2cb-4ef5-95ac-929e2f241751 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.256840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.257492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.257772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.258041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.259376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.260949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473f2c-c0f9-4f0a-9a09-d918bef423c1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.267549 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 528/1071] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:57.268748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.326987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a274c-a77e-4db2-9b71-85e12a9a07e0 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.327501 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a274c-a77e-4db2-9b71-85e12a9a07e0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.327501 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a274c-a77e-4db2-9b71-85e12a9a07e0 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.328856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 529/1072] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:57.333665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e2ff-6bf1-466b-8ec5-76f606e08f45 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.333949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e2ff-6bf1-466b-8ec5-76f606e08f45 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.334222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e2ff-6bf1-466b-8ec5-76f606e08f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.351991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-3c37e2ff-6bf1-466b-8ec5-76f606e08f45 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:57.353159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3c37e2ff-6bf1-466b-8ec5-76f606e08f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:57.370061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9717-4ee3-4db3-a2ad-b3b11f0d881c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.407848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.408459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.408737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.409012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.409784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=15919eee128d48eebb5e6a28efc8c4f3, user.id=0a293d7813fc4f719f2d5ce8253dacd9) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:57.410093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.411524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.418225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 544/1073] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/role_assignments?user.id=0a293d7813fc4f719f2d5ce8253dacd9&scope.project.id=15919eee128d48eebb5e6a28efc8c4f3&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:57.428234 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 530/1074] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:57.698561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.707448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.807196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b85-d654-409a-b0f7-1d0a6edfdca1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.840937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.841410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f106a-16b2-441c-a80d-d58d0bca8132 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.841605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.841723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f106a-16b2-441c-a80d-d58d0bca8132 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.841879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.841974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f106a-16b2-441c-a80d-d58d0bca8132 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.842121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.843395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 531/1075] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:57.848066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.848349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.848620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.866570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:57.867722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:57.879373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.921437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.922905 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.933025 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.944373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 532/1076] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:58.029387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 545/1077] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:26:58.033631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.139175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd5080-c3d9-45ad-b279-3e189a7ebc03 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.173277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.173900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.174178 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.174461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.184634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.186101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.188890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:58.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:58.203659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:58.209563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:58.209563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:58.209563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:58.209563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 533/1078] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:58.209803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.211046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.313943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b70b30-2224-492d-905a-9368ec0fb3a8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.318198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2af55-172b-4c08-b6ca-0182475e25dd None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.321647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.351349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.351984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.352215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.352544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.353105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:58.353428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.355285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.355529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.356148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.356426 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.356849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.377282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 534/1079] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:58.379065 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:58.384430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:58.386002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:26:58.386850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:58.389636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 546/1080] 10.222.0.25 () {56 vars in 1120 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:58.392526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.463423 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.513761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea593f5-522b-492a-ad4e-83223e2cd661 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.550510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.551123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.551401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.551672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.552340 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:58.552643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.554028 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.563148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 535/1081] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:58.569326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.675781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d46fb9-5ece-4b6b-ae89-1beb6dd3c275 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.710242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.710853 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.711134 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.711409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.721874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.723297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:58.737897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:58.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:58.739732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:58.739732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:58.739732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:58.739732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 547/1082] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:58.744678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.840928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190469-ccba-496c-a09d-a274d4847556 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.856908 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.873231 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.873844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.874117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.874383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.875009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:58.875307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.876651 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.888472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 536/1083] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:58.894069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.913374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.991708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45c582-93d9-49e1-a806-002fb466c149 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.024425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.025041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.025351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.026238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.034300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.035730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:59.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:59.047549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:26:59.055016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 548/1084] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:59.055746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.153269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd88a-efc8-47f1-9406-8f18dedce87c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.187636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.188231 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.188503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.188769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.189513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:59.189807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.191205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.216531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 537/1085] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:59.222192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.298815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.320089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb547d-72d8-48bd-9ad3-aed9faaee1ed None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.352260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.352849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.353126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.353441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.420356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.421864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b634046-25c8-41c3-a396-ae1cfdc9adfc None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.500122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.522626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 549/1086] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:59.528289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.551821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e632028-f3aa-46c2-b8ae-949adaee30b2 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.552203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e632028-f3aa-46c2-b8ae-949adaee30b2 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.552482 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e632028-f3aa-46c2-b8ae-949adaee30b2 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.553865 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 550/1087] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:59.559178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.559462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.559734 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.563392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.577832 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:59.579017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:59.628524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e6fde-2865-41b9-ac6c-832cc4731332 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.645636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 551/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:59.661373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.661928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.662527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.672541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.673987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:59.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:59.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:59.690240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:59.690240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:59.690240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:59.690240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 538/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:59.695004 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.789845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dc454-b2b6-4e2d-a93b-38698fe0b237 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.799193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.824631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.825224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.825530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.825796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.826433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:59.826735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.828095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.839319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 552/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:59.844856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.910949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:59.929488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.941790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ff4d-415c-4d55-a455-e719ab46ecf0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.974693 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.975311 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.975593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.975862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.982794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.984223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:59.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:59.996053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:26:59.996996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 539/1091] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:00.002060 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.010132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317afbc7-1f5b-491e-8dc5-1c1ddf611abf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.044232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.044845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.045120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.045428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.057579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:00.062324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:00.063261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:27:00.064115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 553/1092] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:00.069294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:00.098774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da43f-1ad8-432e-94c9-4a494ebae74c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.131416 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.131896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.132174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.132448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.133124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:00.133451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.135185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.146594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 540/1093] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:00.153072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.162876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:00.169076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761853b5-6b92-4fd3-9964-541352581bfa None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.203646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.203930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.204200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.204848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:00.205152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.206531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.214848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 554/1094] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:00.220461 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.256118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc63a8-0078-4cc5-835c-84cef6b79c11 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.290262 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.290856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.291167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.291440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.292152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] RBAC: Adding query filter params (role.id=a4c457636b384fb8a0019b9c5648cab7, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=1ae0aa2cf16f420db7bcb87d4d995901) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:00.292455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.293920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.299456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 541/1095] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:00 2022] GET /identity/v3/role_assignments?user.id=1ae0aa2cf16f420db7bcb87d4d995901&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a4c457636b384fb8a0019b9c5648cab7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:00.307083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:00.318057 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106410e8-b4ae-4ba5-856e-f3ab64f91397 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.355209 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.355861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.356138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.356409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] PATH_INFO: `/v3/users/0a293d7813fc4f719f2d5ce8253dacd9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.357660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] RBAC: Authorizing `identity:get_user(user_id=0a293d7813fc4f719f2d5ce8253dacd9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.359124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.360814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 555/1096] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:00 2022] GET /identity/v3/users/0a293d7813fc4f719f2d5ce8253dacd9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:00.366815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.442575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:00.474767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b0684-41e0-4333-a0ee-60af34c907f2 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.511518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.512145 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.512418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.512688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.513811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.515223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d971a8-85fb-4d6b-a045-e2c703a6607e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.516826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 542/1097] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:00 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:00.522820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:00.622666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6ac22-01c7-4048-9e7a-079ed2a73470 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:00.656856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:00.657531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.657805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.658071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3/users/0a293d7813fc4f719f2d5ce8253dacd9/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.659953 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=15919eee128d48eebb5e6a28efc8c4f3, user_id=0a293d7813fc4f719f2d5ce8253dacd9, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:00.661454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c9d3-daac-4f83-9e30-e31f2b563c57 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:00.674635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 556/1098] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:00 2022] PUT /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3/users/0a293d7813fc4f719f2d5ce8253dacd9/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:02.788093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303678-1f33-4b89-b6a3-6ad393c1f0cb None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.788637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303678-1f33-4b89-b6a3-6ad393c1f0cb None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.788637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303678-1f33-4b89-b6a3-6ad393c1f0cb None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.789943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 543/1099] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:02.795686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.796115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.796221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.814538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:02.815707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:02.828363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.880790 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 557/1100] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:03.162842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed303678-1f33-4b89-b6a3-6ad393c1f0cb None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.260065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed303678-1f33-4b89-b6a3-6ad393c1f0cb None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.292043 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.292649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.292938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.293189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.300339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.303661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:03.309129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:03.310433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:03.312451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 544/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:03.316243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.410899 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ea33c-4f12-433a-a9f9-555df041220c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.444358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.444882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.445157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.445454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.446110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:03.446411 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.447787 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.455495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 558/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:03.461236 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.557264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba40b-7c06-459d-9f8f-9a335a45197b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.588684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.589308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.589584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.589850 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] PATH_INFO: `/v3/users/0a293d7813fc4f719f2d5ce8253dacd9` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.590936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] RBAC: Authorizing `identity:get_user(user_id=0a293d7813fc4f719f2d5ce8253dacd9)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.592342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.593908 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 545/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/users/0a293d7813fc4f719f2d5ce8253dacd9 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.599592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.613363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.696706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8ed60-7015-40eb-be88-26feee1ba162 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.729051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.729656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.729931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.730199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.793959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.795375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.805934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.889831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 559/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:03.895763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.958240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.990846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b1d5-3d81-4775-94b8-b5d33c46518f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.022115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.022723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.023001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.023269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.024388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.026337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211431c-b8c2-4a03-90a2-99806386e40a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.027910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 546/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:04.033794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.128348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9211e8-6c4e-41a6-bb3f-d84625ec00e4 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.139322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.161962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.162536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.162812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.163080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.163796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=15919eee128d48eebb5e6a28efc8c4f3, user.id=0a293d7813fc4f719f2d5ce8253dacd9) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:04.164100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.165532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f44a-29a7-44af-962a-87f6a03e20b1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.171027 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 560/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/role_assignments?user.id=0a293d7813fc4f719f2d5ce8253dacd9&scope.project.id=15919eee128d48eebb5e6a28efc8c4f3&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:06.301957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5313-8deb-4c75-8795-52d982cc82e8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.302525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5313-8deb-4c75-8795-52d982cc82e8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.302525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5313-8deb-4c75-8795-52d982cc82e8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.303810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 547/1107] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:06.309123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.309564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.309708 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.327815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:06.328979 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:06.392957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 561/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:06.659250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a5313-8deb-4c75-8795-52d982cc82e8 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:06.757863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a5313-8deb-4c75-8795-52d982cc82e8 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:06.790632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:06.791240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.791509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.791772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.792844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:06.794279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1cd5b-4405-4289-9d3f-a70af37aa947 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:06.795806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 548/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:06.801625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:06.897235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5be2-92de-4008-948f-2fece3ce21bb None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:06.899484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:06.930079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:06.930600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.930878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.931636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.932290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:06.933744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785492e7-f48d-4516-80f9-0bd902232c94 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:06.954468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 562/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:06 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:09.107361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af745d-013e-40c9-b2f2-b7c84c0bc2c3 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.107877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af745d-013e-40c9-b2f2-b7c84c0bc2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.108000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af745d-013e-40c9-b2f2-b7c84c0bc2c3 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 549/1111] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:09.114532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.114944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.115088 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.132891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:09.134359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:09.203328 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 563/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:09.472348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af745d-013e-40c9-b2f2-b7c84c0bc2c3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.476147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.570949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af745d-013e-40c9-b2f2-b7c84c0bc2c3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.603960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.604568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.604846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.605118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] PATH_INFO: `/v3/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.606521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] RBAC: Authorizing `identity:get_role(role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.607885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:09.609184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 550/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles/4203118e6def4ea283ce4c49694a4892 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:09.614904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.701570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.711557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5bad6-38b5-491d-a305-80dccca82c97 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.744565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.745177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.745483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.745756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] PATH_INFO: `/v3/users/54222ed85c5145f9a12bf44158736bac` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.758372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] RBAC: Authorizing `identity:get_user(user_id=54222ed85c5145f9a12bf44158736bac)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.760044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:09.761647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 564/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/users/54222ed85c5145f9a12bf44158736bac => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:09.767160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.837137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.866922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93441-dd6c-4c4c-a970-d76ffb61fe87 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.898663 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.899245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.899520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.900288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.963193 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.964566 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.028704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.057442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 551/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:27:10.063190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.158811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d528f-e695-481d-8236-3bc2340d71f8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.192292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.192898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.193191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.193490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.194577 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.195980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029f66-c612-464a-9efc-5945518d40b3 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.197661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 565/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.203738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.297855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524eae-db76-4c7a-a8a0-32707362e29b None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.330040 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.330614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.330886 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.331148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.331852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=15919eee128d48eebb5e6a28efc8c4f3, user.id=54222ed85c5145f9a12bf44158736bac) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:10.332152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.333577 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d3ff0-3cc5-4655-81e3-332c81900e75 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.339144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 552/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/role_assignments?user.id=54222ed85c5145f9a12bf44158736bac&scope.project.id=15919eee128d48eebb5e6a28efc8c4f3&role.id=4203118e6def4ea283ce4c49694a4892 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:12.429599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4867-90a3-437d-8d3f-71248b322269 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.430020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4867-90a3-437d-8d3f-71248b322269 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.430127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4867-90a3-437d-8d3f-71248b322269 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.432124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 566/1118] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:12.437229 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.437680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.437783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.455298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:12.456455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:12.484419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.522643 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 553/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:27:12.787540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4867-90a3-437d-8d3f-71248b322269 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.805584 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.884470 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4867-90a3-437d-8d3f-71248b322269 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.916897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.917518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.917792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.918060 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] PATH_INFO: `/v3/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.919421 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] RBAC: Authorizing `identity:get_role(role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:12.920754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:12.922058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 567/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/roles/4203118e6def4ea283ce4c49694a4892 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:12.927670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.020800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8a590-39b2-4910-a3cd-4308cd26c241 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.053456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.054085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.054361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.054626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] PATH_INFO: `/v3/users/54222ed85c5145f9a12bf44158736bac` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.055721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] RBAC: Authorizing `identity:get_user(user_id=54222ed85c5145f9a12bf44158736bac)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.058383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.059916 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 554/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/users/54222ed85c5145f9a12bf44158736bac => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.065511 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.149101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.166271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434d6e-827e-4788-9bcb-85eb782ec035 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.199099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.199714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.199993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.200268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.201402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.202823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466ee48-7cd8-47bf-9fb5-527e30ed8fdc None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.204428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 568/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.210309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.244005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.307217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d74ec3-e138-4790-8c05-61b3a5dabdca None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.337954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.338581 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.338851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.339116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3/users/54222ed85c5145f9a12bf44158736bac/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.341183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] RBAC: Authorizing `identity:create_grant(project_id=15919eee128d48eebb5e6a28efc8c4f3, user_id=54222ed85c5145f9a12bf44158736bac, role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.342623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdbbe3-a178-41d3-92f7-993d50ae7d22 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.355404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 555/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:13 2022] PUT /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3/users/54222ed85c5145f9a12bf44158736bac/roles/4203118e6def4ea283ce4c49694a4892 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:15.447512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3e69-62ad-4912-844a-40160e409b88 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.447982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3e69-62ad-4912-844a-40160e409b88 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.448073 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3e69-62ad-4912-844a-40160e409b88 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.449416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 569/1124] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:15.454631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.455024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.455168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.473114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:15.474294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:15.536878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 556/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:15.803844 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3e69-62ad-4912-844a-40160e409b88 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.901793 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3e69-62ad-4912-844a-40160e409b88 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.934243 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.934856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.935137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.935412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] PATH_INFO: `/v3/roles/4203118e6def4ea283ce4c49694a4892` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.936783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] RBAC: Authorizing `identity:get_role(role_id=4203118e6def4ea283ce4c49694a4892)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.938227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.939514 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 570/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/roles/4203118e6def4ea283ce4c49694a4892 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.944993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.968507 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:16.041404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590239-625a-4572-ae06-209aed6a3a47 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:16.073357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:16.073908 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:16.074181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:16.074449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] PATH_INFO: `/v3/users/54222ed85c5145f9a12bf44158736bac` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:16.075532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] RBAC: Authorizing `identity:get_user(user_id=54222ed85c5145f9a12bf44158736bac)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:16.076938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:16.078488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 557/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/users/54222ed85c5145f9a12bf44158736bac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:16.084084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:16.105599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:16.181071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29e6f-5a9c-4bb7-b5ba-a663fd81fefb None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:16.214076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:16.214655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:16.214934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:16.215205 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:16.279118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:16.280542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:16.301162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:16.376797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 571/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:16.382607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:16.469343 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:16.478800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f205de-366c-490f-b60c-b5161f16dae9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:16.510208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:16.510815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:16.511089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:16.511356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] PATH_INFO: `/v3/projects/15919eee128d48eebb5e6a28efc8c4f3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:16.512432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] RBAC: Authorizing `identity:get_project(project_id=15919eee128d48eebb5e6a28efc8c4f3)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:16.513948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73cdfc-c19f-4889-a8a8-e6e79f495750 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:16.515533 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 558/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:16 2022] GET /identity/v3/projects/15919eee128d48eebb5e6a28efc8c4f3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:16.521671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:16.616562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f269d-ef19-4659-b864-2be13a92c767 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:16.635863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:16.649919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:16.650502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:16.650781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:16.651055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:16.651768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] RBAC: Adding query filter params (role.id=4203118e6def4ea283ce4c49694a4892, scope.project.id=15919eee128d48eebb5e6a28efc8c4f3, user.id=54222ed85c5145f9a12bf44158736bac) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:16.652073 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:16.653503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb77cb-f1c3-457e-a747-3f7a46b8f62a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:16.658960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 572/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:16 2022] GET /identity/v3/role_assignments?user.id=54222ed85c5145f9a12bf44158736bac&scope.project.id=15919eee128d48eebb5e6a28efc8c4f3&role.id=4203118e6def4ea283ce4c49694a4892 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:18.787261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c3dd-644a-4873-9fa0-82461fa1d84c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.787756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c3dd-644a-4873-9fa0-82461fa1d84c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.787756 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c3dd-644a-4873-9fa0-82461fa1d84c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.789073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 559/1131] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:18.794912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.795318 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.795458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.813144 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:18.814339 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:18.877123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 573/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:19.143061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c3dd-644a-4873-9fa0-82461fa1d84c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.246356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c3dd-644a-4873-9fa0-82461fa1d84c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.279185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.279795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.280072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.280344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.281462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.282893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9261a7-b4c1-4a94-88ba-acef5e63d91a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.284430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 560/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:19.290193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.383388 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9713d0-8dfb-4aa6-9018-7a78ad0742d5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.397589 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.417564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.418161 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.418441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.418714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.419376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.420791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579ae55-1f1b-4532-af47-a65c50377c37 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.446939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 574/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:27:19 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:27:21.597692 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373823b6-4c5f-414c-9f0c-5bfd456f359c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:21.598286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373823b6-4c5f-414c-9f0c-5bfd456f359c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:21.598286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373823b6-4c5f-414c-9f0c-5bfd456f359c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:21.599555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 561/1135] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:21.605491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:21.605891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:21.606079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:21.624467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:21.625681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:21.689946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 575/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:27:21.956314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373823b6-4c5f-414c-9f0c-5bfd456f359c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:21.982888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:22.053934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373823b6-4c5f-414c-9f0c-5bfd456f359c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:22.087919 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:22.088532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.088808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.089076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:22.090196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:22.091615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf229-26ed-45a3-8d6a-240c3b1887df None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:22.093166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 562/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:22.098990 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:22.188151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:22.194298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bd07-e404-485f-81b2-8e1535018fb0 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:22.226859 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:22.227891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.228168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.228433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:22.229070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:22.230520 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd3f8-4c7d-4750-a26c-e774b51a54c4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:22.251531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 576/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:22 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:24.398660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8441-3cd5-433a-aca8-e103c9cd1c61 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.399755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8441-3cd5-433a-aca8-e103c9cd1c61 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.399859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8441-3cd5-433a-aca8-e103c9cd1c61 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.401132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 563/1139] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:24.406298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.406683 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.406841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.425156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:24.426342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:24.489615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 577/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:24.757330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8441-3cd5-433a-aca8-e103c9cd1c61 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.847414 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.854300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8441-3cd5-433a-aca8-e103c9cd1c61 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.886569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.887174 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.887451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.887724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.897308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:24.902527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.903668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:24.904705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 564/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.909593 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.987491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.005281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c73dc-dfa5-4cdf-a399-fc981e098492 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.037858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.038393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.038672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.038940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.040187 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.040487 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.041855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.049787 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 578/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.056882 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.153056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbb9ec-b1f8-4a0d-9970-10fc5b1c65d1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.184733 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.185363 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.185644 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.185991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] PATH_INFO: `/v3/users/9b8ae305569d43438463956fc50d082d` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.198932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b8ae305569d43438463956fc50d082d)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.200357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.201944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 565/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/users/9b8ae305569d43438463956fc50d082d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.208304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.303904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729817-427d-4bdb-ad06-0cdeef84b67b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.335750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.336349 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.336659 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.336930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.350479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.401715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.403138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.498815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 579/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:25.504683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.519827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.599158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6907cb8-847f-4bf7-9030-52f9924b4ee7 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.631262 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.637147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.637147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.637147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] PATH_INFO: `/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.637147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] RBAC: Authorizing `identity:get_project(project_id=e9544b3dfb33467c91ebbd5cbef25acb)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.637147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f28ecf-2e9b-4100-89e6-be59d82b9419 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.637627 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 566/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.643247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.687686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.739152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439d3f0-cbcd-48a6-9e83-5fc554505900 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.772141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.772725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.773002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.773300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.774046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=e9544b3dfb33467c91ebbd5cbef25acb, user.id=9b8ae305569d43438463956fc50d082d) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.774353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738181bc-9b77-4d52-a2dc-556b8775901b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.780920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 580/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/role_assignments?user.id=9b8ae305569d43438463956fc50d082d&scope.project.id=e9544b3dfb33467c91ebbd5cbef25acb&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.899636 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e824-1283-4db1-9869-7c224556fc6a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.900183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e824-1283-4db1-9869-7c224556fc6a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.900183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e824-1283-4db1-9869-7c224556fc6a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.901524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 567/1147] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:27.906572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.907001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.907100 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.925474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:27.926643 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:27.989453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 581/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:28.259971 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e824-1283-4db1-9869-7c224556fc6a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.339129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.358932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e824-1283-4db1-9869-7c224556fc6a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.391531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.392139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.392412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.392679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.402899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:28.407555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:28.408712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:28.410107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 568/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:28.414794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.453353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.510196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9b4f-d594-4aa5-835c-ac789a22fc08 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.541954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.542538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.542815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.543086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.543741 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.544041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.545481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.553193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 582/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.559453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.654358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8edc7-6a20-403d-8a28-593a504fa45e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.686253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.686846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.687118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.687384 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] PATH_INFO: `/v3/users/9b8ae305569d43438463956fc50d082d` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.688471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] RBAC: Authorizing `identity:get_user(user_id=9b8ae305569d43438463956fc50d082d)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.689912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.691431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 569/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/users/9b8ae305569d43438463956fc50d082d => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.697028 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.793091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.796196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c753803-6ea4-4c52-a8ad-15df7467cae8 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.828146 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.828748 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.829022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.829314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] PATH_INFO: `/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.830397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] RBAC: Authorizing `identity:get_project(project_id=e9544b3dfb33467c91ebbd5cbef25acb)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.831800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b686cfd-45ec-405e-b219-ffbf7a974b4f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.833394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 583/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:28.839728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.851903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.935822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f9c8-e34f-4ec2-8218-9818ec799634 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.967511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.968153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.968428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.968701 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] PATH_INFO: `/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb/users/9b8ae305569d43438463956fc50d082d/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.970590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] RBAC: Authorizing `identity:create_grant(project_id=e9544b3dfb33467c91ebbd5cbef25acb, user_id=9b8ae305569d43438463956fc50d082d, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.972007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c22c3-bed8-464f-b4e4-055d0e28791f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.985144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 570/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:28 2022] PUT /identity/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb/users/9b8ae305569d43438463956fc50d082d/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:31.093625 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d2e37-f8f4-4ae3-b3e9-aef38bf563b5 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.094181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d2e37-f8f4-4ae3-b3e9-aef38bf563b5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.094181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d2e37-f8f4-4ae3-b3e9-aef38bf563b5 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.095482 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 584/1154] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:31.100671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.101057 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.101224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.119832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:31.120992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:31.179708 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.185568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 571/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:31.454079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d2e37-f8f4-4ae3-b3e9-aef38bf563b5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.553048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d2e37-f8f4-4ae3-b3e9-aef38bf563b5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.585882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.586504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.586782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.587054 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.597148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:31.601917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:31.603017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:27:31.604131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 585/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:31.608699 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.703661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc952e-c00a-4286-9cc3-89d07f2105fe None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.735553 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.736138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.736415 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.736684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.737372 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:31.737672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.739025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.747202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 572/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:31.752839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.780730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.849358 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1bc36-49bf-459e-a594-8d59108d15d1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.881014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.881641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.881919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.882190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] PATH_INFO: `/v3/users/9b8ae305569d43438463956fc50d082d` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.884082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=9b8ae305569d43438463956fc50d082d)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.885513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 586/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/users/9b8ae305569d43438463956fc50d082d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:31.892543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.950921 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.989319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3bad-3bb7-4651-9704-e809f141bca5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.021363 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.021951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.022225 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.022494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.085664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.087246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.143246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.181754 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 573/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:32.187635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.278191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.284250 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd128-792b-4cef-bbc7-2de47beb3ad0 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.316493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.317097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.317398 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.317668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] PATH_INFO: `/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.318746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] RBAC: Authorizing `identity:get_project(project_id=e9544b3dfb33467c91ebbd5cbef25acb)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.320138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1466777-27f8-46ff-b366-1b4963922b6c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.322301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 587/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/projects/e9544b3dfb33467c91ebbd5cbef25acb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:32.328149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.420887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7321d4-1b37-459e-a399-0022ed43e015 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.453269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.453874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.454148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.454415 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=e9544b3dfb33467c91ebbd5cbef25acb, user.id=9b8ae305569d43438463956fc50d082d) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.455455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.456865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5a14-9905-4c30-881c-4a7990b5bd9e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.462878 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 574/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/role_assignments?user.id=9b8ae305569d43438463956fc50d082d&scope.project.id=e9544b3dfb33467c91ebbd5cbef25acb&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.611268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157da01-d922-4845-8ea3-dd4dbf6ca2c1 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.611805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157da01-d922-4845-8ea3-dd4dbf6ca2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.611805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157da01-d922-4845-8ea3-dd4dbf6ca2c1 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.613142 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 588/1162] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:27:34.618822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.619208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.619379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.637890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:34.639046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:34.658187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.703351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 575/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:34.968812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157da01-d922-4845-8ea3-dd4dbf6ca2c1 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.065381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157da01-d922-4845-8ea3-dd4dbf6ca2c1 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.097445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.098021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.098293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.098558 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.126909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.162602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.164038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.256229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 589/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:35.262877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.356297 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3f6a8-aed6-471a-8967-0f0f16883386 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.388970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.389599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.389874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.390139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.396373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.397823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b11156b5-8aec-4947-9020-31a29a4111f5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:35.408815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:35.410198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:35.411430 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 576/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:35.415871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.474797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.510710 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ebe6f-6f14-45d2-a0a9-56d381e76cbb None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.542266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.542849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.543125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.544029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:35.544330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.545716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9dc0c-222c-4196-a58c-e8a94af30dbc None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.552532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 590/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:37.665078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a21-b306-410d-a8e9-42c4d88e90cf None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.665626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a21-b306-410d-a8e9-42c4d88e90cf None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.665626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739a21-b306-410d-a8e9-42c4d88e90cf None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.666904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 577/1167] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:37.672038 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564395-8165-4c28-8aee-0b9dc2703e3c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.672468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564395-8165-4c28-8aee-0b9dc2703e3c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.672579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564395-8165-4c28-8aee-0b9dc2703e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.690758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-3c564395-8165-4c28-8aee-0b9dc2703e3c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:37.691922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-3c564395-8165-4c28-8aee-0b9dc2703e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:37.755656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 591/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:38.017885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739a21-b306-410d-a8e9-42c4d88e90cf None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.036104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.115295 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739a21-b306-410d-a8e9-42c4d88e90cf None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:38.147260 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:38.147841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.148186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.148454 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.149098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:38.150472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df9bf-d319-45d8-9ce3-f7c5d820e2c8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:38.166551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 578/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Fri Sep 30 09:27:38 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:40.293274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8453f-2a54-4bc4-ae9d-fdccf8943afd None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.293901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8453f-2a54-4bc4-ae9d-fdccf8943afd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.293901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8453f-2a54-4bc4-ae9d-fdccf8943afd None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.295180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 592/1170] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:40.300277 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.300640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.300827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.318427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:40.319591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:40.383431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 579/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:40.650781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8453f-2a54-4bc4-ae9d-fdccf8943afd None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.709128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.750124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8453f-2a54-4bc4-ae9d-fdccf8943afd None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.783966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.784585 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.784864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.785138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] PATH_INFO: `/v3/domains/0e29fc62d5c042d7b2f62bbb3d1dc822` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.795465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e29fc62d5c042d7b2f62bbb3d1dc822)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.797048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c57b6-75cf-481a-95cb-07a73aa1bbeb None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.798777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 593/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/domains/0e29fc62d5c042d7b2f62bbb3d1dc822 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:40.805127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.813163 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.902453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d30ff0-4fb0-4cef-8a65-11d8cc920f61 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.935253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.935844 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.936120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.936387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.937018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.938461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bdbcd-722b-421d-a799-643e9cb3ba48 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.964438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 580/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:27:40 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:43.105954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7504f0-ad56-496f-a6b9-9d0c27bb4b3b None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.106467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7504f0-ad56-496f-a6b9-9d0c27bb4b3b None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.106560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7504f0-ad56-496f-a6b9-9d0c27bb4b3b None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.107831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 594/1174] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:43.112935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.113381 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.113518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.131790 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:43.133319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:43.183952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.203014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 581/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:43.471293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7504f0-ad56-496f-a6b9-9d0c27bb4b3b None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.568549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7504f0-ad56-496f-a6b9-9d0c27bb4b3b None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.584357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.601104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.601747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.602026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.602298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] PATH_INFO: `/v3/domains/0e29fc62d5c042d7b2f62bbb3d1dc822` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.603396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e29fc62d5c042d7b2f62bbb3d1dc822)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.604821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6867a2-e6ab-4cf1-b7c5-5fc6c9c9fee9 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.606383 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 595/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/domains/0e29fc62d5c042d7b2f62bbb3d1dc822 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:43.611893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.707548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4049d4f-65c2-4f4c-93e7-e550a5411dbf None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.739038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.739617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.739891 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.740158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.740799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.742747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b97c7-c5d4-4106-a267-fef9c73555ca None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.764609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 582/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:43 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:45.939997 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe39a-b19f-43a6-9e7f-efd9d7a6b517 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.940547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe39a-b19f-43a6-9e7f-efd9d7a6b517 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.940547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe39a-b19f-43a6-9e7f-efd9d7a6b517 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.941917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 596/1178] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:45.947132 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.947493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.947686 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.965765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:45.966934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:46.006083 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.033852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 583/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:46.300984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe39a-b19f-43a6-9e7f-efd9d7a6b517 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.399746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe39a-b19f-43a6-9e7f-efd9d7a6b517 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.433301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.433918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.434192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.434461 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.444557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:46.449311 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:46.450443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:27:46.451493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 597/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:46.456325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.550911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e9cf2-a9f6-4ad5-9308-689c7e8ecff9 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.582711 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.583244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.583524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.583795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.584453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:46.584752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.586654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.594325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 584/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:46.600017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.645080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.696841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2144844-5e6e-4f8b-8a45-8e4eaee0339b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.729773 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.730377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.730656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.730928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] PATH_INFO: `/v3/users/23194c2db4864711b96ac2e83704ae8b` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.743430 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] RBAC: Authorizing `identity:get_user(user_id=23194c2db4864711b96ac2e83704ae8b)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.744845 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.746423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 598/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/users/23194c2db4864711b96ac2e83704ae8b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:46.752038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.786170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.848230 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530bfd7-1d6e-481b-ace8-9bac52558aed None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.882036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.882623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.883167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.883438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.947009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.948429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.979607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.040532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 585/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:47.046652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf65bc1-2793-4df7-a961-f51973cb451e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.144177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.175210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.175816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.176093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.176362 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] PATH_INFO: `/v3/projects/149aad34bdac4311aac8af02b3c77ec4` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.177488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] RBAC: Authorizing `identity:get_project(project_id=149aad34bdac4311aac8af02b3c77ec4)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.179513 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec228e-fa69-4471-abb2-243bc166fe5f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.181105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 599/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/projects/149aad34bdac4311aac8af02b3c77ec4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:47.187102 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.280513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935619db-309d-420d-a6cc-42ac23d70352 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.313494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.313956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.314417 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.315686 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=149aad34bdac4311aac8af02b3c77ec4, user.id=23194c2db4864711b96ac2e83704ae8b) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:47.316245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.318914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bf136-0e93-4dff-9ff7-8f99b83158ec None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.323464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.328326 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 586/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/role_assignments?user.id=23194c2db4864711b96ac2e83704ae8b&scope.project.id=149aad34bdac4311aac8af02b3c77ec4&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:49.415705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b698-2768-43d5-99f0-00224baa70bc None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.416104 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b698-2768-43d5-99f0-00224baa70bc None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.416248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b698-2768-43d5-99f0-00224baa70bc None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.417615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 600/1186] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:49.422648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.423080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.423195 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.441235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:49.442421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:49.504781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 587/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:27:49.770443 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b698-2768-43d5-99f0-00224baa70bc None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.867614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b698-2768-43d5-99f0-00224baa70bc None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.900554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.901149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.901452 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.901718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.911206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:49.915876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:49.917009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:27:49.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 601/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:49.923064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.017574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02cdbc-b8d8-42b2-9ec9-a4f4f1721d6b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.044630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.050613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.051196 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.051472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.051745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.052393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:50.052698 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.054109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.061722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 588/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.067435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.098704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.164052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601d55-13b7-4cfc-8dee-178d05366c2c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.197007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.197633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.197909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.198176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] PATH_INFO: `/v3/users/23194c2db4864711b96ac2e83704ae8b` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.199280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] RBAC: Authorizing `identity:get_user(user_id=23194c2db4864711b96ac2e83704ae8b)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.200680 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.202258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 602/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/users/23194c2db4864711b96ac2e83704ae8b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.207960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.304550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efc33-1bab-4634-b2f4-5b6a42748fe0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.336085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.336684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.336961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.337226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] PATH_INFO: `/v3/projects/149aad34bdac4311aac8af02b3c77ec4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.338347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] RBAC: Authorizing `identity:get_project(project_id=149aad34bdac4311aac8af02b3c77ec4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.339763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4ac1f-e612-48ec-9873-31a2e7ba3c17 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.341350 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 589/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/projects/149aad34bdac4311aac8af02b3c77ec4 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.347002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.441590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.444590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1bf-3b5c-4bf4-8392-c66f84df77ac None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.478863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.479498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.479775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.480045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] PATH_INFO: `/v3/projects/149aad34bdac4311aac8af02b3c77ec4/users/23194c2db4864711b96ac2e83704ae8b/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.481911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] RBAC: Authorizing `identity:create_grant(project_id=149aad34bdac4311aac8af02b3c77ec4, user_id=23194c2db4864711b96ac2e83704ae8b, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.483329 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8edd9-7d45-495d-a8e4-5ef387211767 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.495345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 603/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:50 2022] PUT /identity/v3/projects/149aad34bdac4311aac8af02b3c77ec4/users/23194c2db4864711b96ac2e83704ae8b/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:52.595095 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f4-e1fe-4ce2-a553-1ee117bb5e9c None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.595612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f4-e1fe-4ce2-a553-1ee117bb5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.595727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f4-e1fe-4ce2-a553-1ee117bb5e9c None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.596966 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 590/1193] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:52.602635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.603011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.603179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.620755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:52.621952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:52.684670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 604/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:27:52.957924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f4-e1fe-4ce2-a553-1ee117bb5e9c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.015497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.055816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f4-e1fe-4ce2-a553-1ee117bb5e9c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.088262 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.088865 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.089140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.089433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.098900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:53.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:53.104670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:27:53.105562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 591/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:53.110551 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.197893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.208001 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ccd35-1156-4279-9cfa-371013955605 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.239856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.240441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.240718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.241536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.242195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.242494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.243841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.251561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 605/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.258263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.360429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbe74-bf4b-4b56-a9bd-6e4a00650b87 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.379935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.393988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.394599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.394876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.395147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] PATH_INFO: `/v3/users/23194c2db4864711b96ac2e83704ae8b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.396243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] RBAC: Authorizing `identity:get_user(user_id=23194c2db4864711b96ac2e83704ae8b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.398243 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.399800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 592/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/users/23194c2db4864711b96ac2e83704ae8b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.405696 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.501944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d863aa5-7ab9-4765-b7c0-c6b74fdd19da None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.537543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.538747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.539025 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.539294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.559412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.604137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.605599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.698847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 606/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:27:53.704906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.799752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19101a1-9286-439d-906a-08feeb00d634 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.831510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.832111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.832388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.832656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] PATH_INFO: `/v3/projects/149aad34bdac4311aac8af02b3c77ec4` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.833765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=149aad34bdac4311aac8af02b3c77ec4)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.835265 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911b3e-526e-45ad-b7c9-5497349ea1f3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.836846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 593/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/projects/149aad34bdac4311aac8af02b3c77ec4 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.842872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.895490 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.940737 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a579-0d94-4d03-be9f-ebb7ead17b5f None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.973522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.974107 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.974385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.974655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.975446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=149aad34bdac4311aac8af02b3c77ec4, user.id=23194c2db4864711b96ac2e83704ae8b) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.975756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.977166 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964fd2b-6451-4507-a02d-2185af60e129 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.982768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 607/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/role_assignments?user.id=23194c2db4864711b96ac2e83704ae8b&scope.project.id=149aad34bdac4311aac8af02b3c77ec4&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:03.827554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=72 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.980186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=42 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:49.345124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553788-0c08-4749-a238-bb5de5fa0c95 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:49.345788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553788-0c08-4749-a238-bb5de5fa0c95 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:49.345788 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553788-0c08-4749-a238-bb5de5fa0c95 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:49.348293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 594/1201] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:49.355357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:49.355878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:49.355878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:49.375444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:49.376977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:49.475021 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 608/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:49.878812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b553788-0c08-4749-a238-bb5de5fa0c95 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.028938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b553788-0c08-4749-a238-bb5de5fa0c95 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.076242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.077204 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.077645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.078023 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.090735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.092349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:50.115620 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:50.116781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:50.117800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:50.117800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:50.117800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:28:50.117800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 595/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:50.123657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.256782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ac32-ae1d-44ed-bda7-4191c8c366df None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.294361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.303188 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.303800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.304136 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.304415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.305072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:50.305404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.306831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99611-dc79-4d7f-b155-38c331991de4 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.324821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 609/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:50.330948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.458126 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.516569 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e903-505a-41c0-a627-2ef26ce10c18 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.561369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.562031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.562366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.562619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.563335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.564861 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60391-4d93-4b7a-90d2-23dd720516bf None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.601299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 596/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 30 09:28:50 2022] POST /identity/v3/users => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:53.063854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8b23-a3ca-4daa-add3-5d77def636c7 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.064507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8b23-a3ca-4daa-add3-5d77def636c7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.064507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8b23-a3ca-4daa-add3-5d77def636c7 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.067308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 610/1206] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:28:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:53.073510 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.073998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.074100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.100293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:53.101993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:53.190293 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 597/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:53.467196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e8b23-a3ca-4daa-add3-5d77def636c7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.593693 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e8b23-a3ca-4daa-add3-5d77def636c7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.647039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.647672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.647955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.648229 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.662578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:53.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:53.669003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:53.670101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 611/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:53.676291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.723749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:53.802188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a9c0-6fb3-4759-8757-0c75581a6de7 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.840956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.841655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.842002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.842270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.843007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:53.843308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:53.844821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:53.855800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 598/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:53.862868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.926155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.008620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a864582-476b-421f-bf9f-3e5d636e0443 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.048479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.049101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.049433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.049698 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.063807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.065323 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:54.082263 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:54.083934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:54.090701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:54.090701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:54.090701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:54.090701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 612/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:54.090952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.201641 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.204710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da632d-7e83-4d59-b6a6-6ecce09b481e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.247368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.247967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.248240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.248502 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.249135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:54.249457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.250812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.264447 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 599/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:54.270926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.386930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565460b-1ce4-4d63-85d5-4df50f7fb6c1 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.389011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.424294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.424977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.425276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.425548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.433713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.435249 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:54.448538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:54.449624 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:54.455648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 613/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:54.456854 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.574393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78153e3-8d83-41b0-b884-48f42d7e780c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.615564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.616168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.616445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.616716 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.617726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:54.618037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.619876 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.640108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 600/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:54.646561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9273-447a-4343-8016-a2f196295caf None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.802178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.802796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.803075 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.803345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.835360 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.883932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.885427 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.016395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 614/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:55.023486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:55.054554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:55.177590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d33f-575c-4724-91ec-1b4fef42252d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:55.217032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:55.217752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:55.218029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:55.218296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:55.228935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:55.230428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:55.245913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:55.247794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:55.249213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:55.249213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:55.249213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:28:55.249213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 601/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:55.253370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:55.321863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:55.362385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700b33-9d6f-49a3-9339-1e40d2b5c603 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:55.407083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:55.407697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:55.407978 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:55.408242 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:55.410070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:55.410070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:55.412112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.430934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 615/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:55.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:55.511089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:55.547580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc062d-55f4-4c1b-9bdf-23b094b056a8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:55.590906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:55.592665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:55.592980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:55.593215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:55.601352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:55.603028 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:55.616726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:55.617950 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:28:55.619033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 602/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:55.624587 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:55.742271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61607d-0ea5-475f-b46a-3adc37799f7b None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:55.765404 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:55.778045 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:55.778615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:55.778960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:55.779299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:55.780056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:55.780428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:55.782064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01504-ec14-47ed-b65f-fa094efc3d30 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.797794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 616/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:55.804608 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:55.915200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643e853-acba-40df-affa-e7abbd360c88 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:55.947451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:55.954477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:55.955333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:55.955661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:55.955938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:55.957335 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=f526261ef68741719e636497d86446f7) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:55.957640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:55.959103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839671-118e-40ae-aa19-afdb89ee27eb None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:55.970276 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 603/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:55 2022] GET /identity/v3/role_assignments?user.id=f526261ef68741719e636497d86446f7&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:58.341314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975e9e-f19d-4d42-b66e-ebfd46c95862 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:58.341848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975e9e-f19d-4d42-b66e-ebfd46c95862 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:58.341848 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975e9e-f19d-4d42-b66e-ebfd46c95862 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:58.343170 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 617/1220] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:58.349023 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:58.349432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:58.349748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:58.370495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:58.371685 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:58.448171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 604/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:58.746000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975e9e-f19d-4d42-b66e-ebfd46c95862 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:58.859216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975e9e-f19d-4d42-b66e-ebfd46c95862 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:58.898271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:58.899036 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:58.899392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:58.899762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:58.912236 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:58.917029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:58.918418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:58.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 618/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:28:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:58.924593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.030523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869364f-1b48-47fd-944a-03284090f8ee None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.054315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.068463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.069571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.070361 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.070839 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.071787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] RBAC: Adding query filter params (name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:59.072135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.074441 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.093396 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 605/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:59.094948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.148111 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.212838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93cb67-b55b-4343-8062-1795f3abff77 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.248968 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.249614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.249888 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.250155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.261112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.262816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:59.277895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:59.279037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:59.280267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:59.280267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:59.280267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:59.280267 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 619/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:59.285082 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.395799 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64297-f96f-4998-96f6-ce0b8557915e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.437410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.438121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.438513 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.438829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.439689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:59.439998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.441709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.454025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 606/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:59.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.566508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.574767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53427-cf7c-4922-994c-d2936ba53e7a None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.614621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.615182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.615459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.615724 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.624033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.625503 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:59.637613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:59.643501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:28:59.644691 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 620/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:59.645456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.693664 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.749183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041da18-967a-4180-b62d-ac77750c0fe8 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.788307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.788913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.789189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.789503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.790235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:59.790541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.791972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.810438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 607/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:59.817149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.929496 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4b3c-244d-4aba-af5b-ec3cb6836070 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.966613 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.967271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.967633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.968005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.982403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.983842 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:00.000581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:00.002086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:00.003289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:00.003289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:00.003289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:00.003289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 621/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:00.008160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:00.133108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffca5b-9c85-42cf-86de-53da238c0934 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.135834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.169349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.170061 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.170458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.170811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.171530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:00.171829 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.173200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.186607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 608/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:00.192754 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:00.202502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.301855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cf58-f02c-4e03-b2b2-2bde6ed26ba2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.336041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.336653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.336940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.337208 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.343836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.345290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:29:00.360116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:00.361186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:00.362799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 622/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:29:00.367591 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:00.486941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cb41-c428-4cf8-a743-9f61f0f1de9f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.525946 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.526544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.526819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.527085 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.527827 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:00.528188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.529639 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa868c4-0765-41cf-ae1c-d1b47df72a52 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.543073 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 609/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:00.549586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:00.626140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.663893 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440190b0-e864-45b3-97a0-359b33976495 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.699465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.700126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.700419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.700668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/f526261ef68741719e636497d86446f7/roles/a94af6f9793c444ea897d2f7f35a90b0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.714863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=f526261ef68741719e636497d86446f7, role_id=a94af6f9793c444ea897d2f7f35a90b0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.716297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88bf57-0d27-417d-a016-6ba33d7f9f37 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.728726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 623/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:29:00 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/f526261ef68741719e636497d86446f7/roles/a94af6f9793c444ea897d2f7f35a90b0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:29:03.100483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5adc4-c56f-4cf1-8ef6-d3cc734a21d1 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.101385 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5adc4-c56f-4cf1-8ef6-d3cc734a21d1 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.101385 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5adc4-c56f-4cf1-8ef6-d3cc734a21d1 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.102409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 610/1233] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:03.108224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.108824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.108824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.126653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:03.127874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:03.202290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 624/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:03.472881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5adc4-c56f-4cf1-8ef6-d3cc734a21d1 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.498502 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.582629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5adc4-c56f-4cf1-8ef6-d3cc734a21d1 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.618448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.619072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.619347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.619617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.629961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:03.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:03.636468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:03.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 611/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:03.642823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.690533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.747097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76324-1d5a-4179-8fdb-801cd903d39a None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.783537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.784770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.785044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.785344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.786005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] RBAC: Adding query filter params (name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:03.786304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.787690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.796309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 625/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:03.802390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.896943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.913835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f409a-df44-46dd-ad3f-07668fa0d786 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.948947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.949531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.949896 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.950103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.962493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.964036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:03.978840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:03.979961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:03.980869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:03.980869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:03.980869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:03.980869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 612/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:03.985861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.102181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11639154-9145-4931-88b2-83c06ad2a765 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:04.113412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:04.149559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:04.150369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.150679 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.151010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.151984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:04.152466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:04.154485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:04.168376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 626/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:29:04.174445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.283203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f807-4ad3-463b-b937-0e9e399bacd5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:04.320372 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:04.320999 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.321336 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.321616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.326328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:04.332906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:04.334537 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:29:04.346462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:04.347795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:04.349072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 613/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:04.353720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.472756 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13f18-3a69-43cd-a4b2-c5c7c397798d None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:04.509172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:04.509827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.510074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.510389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.511174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:04.511524 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:04.513042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:04.531381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 627/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:29:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:04.538479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.654406 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322bddb-7d5b-4e2f-be28-7c01fe88a6d7 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:04.691166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:04.691845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.692122 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.692487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.759213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:04.766808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:04.768884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:04.879119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 614/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:29:04.886016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.920817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:05.012424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23034b8-8915-46d4-8085-70a968571744 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.048722 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.049413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.050231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.050538 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.061290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.062709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:05.078634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:05.079775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:05.081709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:05.081709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:05.081709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:05.081709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 628/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:05.086730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:05.186431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:05.192395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b308d6-362f-4716-b6fa-862c8ff4f16c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.230981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.231735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.232106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.232449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.233211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:05.233612 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.235078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.246877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 615/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:05.253338 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:05.337583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:05.360570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450512ce-1b80-457c-a681-367b1af1b077 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.398502 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.399204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.399485 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.399752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.407049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.408395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:29:05.420556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:05.421783 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:05.423085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:05.427198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 629/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:05.428490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:05.541294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c624f-559b-4593-8138-d9b410c8ab1d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.579227 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.579942 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.580290 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.580593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.581359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:05.581662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.583245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bb352-1ece-4953-b01c-3a733dfdae20 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.596969 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 616/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:05.603115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:05.711686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471408-a170-4b2e-804c-ab2c69ebb6a2 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.750985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.751782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.752113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.752976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.753876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] RBAC: Adding query filter params (role.id=a94af6f9793c444ea897d2f7f35a90b0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=f526261ef68741719e636497d86446f7) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:05.754211 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.756147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ee4-f911-43eb-b8a4-a30fec2c5954 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.763458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 630/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:05 2022] GET /identity/v3/role_assignments?user.id=f526261ef68741719e636497d86446f7&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=a94af6f9793c444ea897d2f7f35a90b0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:29:08.349668 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78d5-2715-4c7a-9979-0f58683f0994 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:08.350255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78d5-2715-4c7a-9979-0f58683f0994 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:08.350359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef78d5-2715-4c7a-9979-0f58683f0994 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:08.352075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 617/1247] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:08.358207 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:08.358618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:08.358887 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:08.365755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:08.380139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:08.381739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:08.463486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 631/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:08.747419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef78d5-2715-4c7a-9979-0f58683f0994 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:08.766077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:08.852115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef78d5-2715-4c7a-9979-0f58683f0994 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:08.888001 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:08.888630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:08.888903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:08.889168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:08.899710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:08.904495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:08.905642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:08.910490 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 618/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:08.912653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.016791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3f059-233e-4cd6-a13f-698b63b70a17 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.047863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.054782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.055390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.055669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.055944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.056615 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:09.056918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.058435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.069026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 632/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:09.076268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.163982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.186849 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b62e-1904-4949-ad97-c8ac195062a5 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.222183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.222807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.223086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.223358 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.233063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.234521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:09.248428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:09.249631 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:09.250887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:09.250887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:09.250887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:09.250887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 619/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:09.255395 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c5f8-6ae9-498e-ab4d-fda3c5f881da None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.387020 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.387583 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.387860 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.388126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.388749 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:09.389046 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.390424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.402294 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 633/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:09.407851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.514937 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982ad-e468-42f1-8914-5e6bdcbc075d None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.539670 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.547370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.547978 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.548250 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.548514 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.555550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.556961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:29:09.568053 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:09.569170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:09.570359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 620/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:09.574927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.628915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.671508 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bfc3e-babb-496b-896b-6dfa121b0786 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.704517 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.705094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.705415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.705686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.706399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:09.706695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.708083 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.724259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 634/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:09.729853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.831905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30da8-3855-4c82-aa55-89868ba072e0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.863596 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.864180 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.864452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.864719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.921211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.933217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.934682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.027855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 621/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:10.033666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.134301 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534245d-8596-44dd-bc5e-1e86f3aade19 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.146799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:10.167296 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.167903 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.168174 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.168436 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.178970 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.180331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:10.194550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:10.195652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:10.196761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:10.196761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:10.196761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:10.196761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 635/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:10.201295 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.283222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:10.295106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffd43-9774-4cfe-836e-604e8f8f7ea9 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.327571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.328152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.328425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.328690 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.329337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:10.329630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.331563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.342005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 622/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:10.347486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.446988 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12bb1-75ff-4d9f-9ff5-875cf7ebd068 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.478406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.479015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.479297 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.479568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.485920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.487861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:29:10.498645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:10.499700 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:10.500820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 636/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:10.506432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.599720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e831b-7d7f-459f-b2e6-a48bd7a22ddc None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.632142 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.632721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.632994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.633287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.633948 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:10.634244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.635637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834accd-ea0e-4ee5-91e8-2088c14c9ec4 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.646863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 623/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:10.652606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.677617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:10.748982 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0541ae-e22d-4fa8-8a1a-9004ed8131cd None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.782018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.782592 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.782868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.783139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.783898 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=f526261ef68741719e636497d86446f7) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:10.784200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.785689 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915b0b-f962-45f6-898b-5f446c278453 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.790854 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 637/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/role_assignments?user.id=f526261ef68741719e636497d86446f7&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:29:12.863642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a8df-6871-4577-bc6d-e3484c040479 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.864186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a8df-6871-4577-bc6d-e3484c040479 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.864186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a8df-6871-4577-bc6d-e3484c040479 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.865610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 624/1261] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:12.870690 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.871102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.871240 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.889159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:12.890353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:12.954307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 638/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:13.226954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a8df-6871-4577-bc6d-e3484c040479 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.238257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.325378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a8df-6871-4577-bc6d-e3484c040479 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.357671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.358282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.358560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.358832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.369379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:13.374077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:13.375148 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:13.376354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 625/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:13.381399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.398855 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.477085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adabb-160e-4c71-a988-97e876cdf303 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.510148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.510740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.511012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.511278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.511932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:13.512226 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.521580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 639/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:13.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.591910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.623183 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74ab3a-33db-4596-adad-fda684ab2c5e None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.655458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.656056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.656328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.656595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.665933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.667352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:13.681632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:13.682717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:13.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:13.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:13.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:13.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 626/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:13.688389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.766620 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.785863 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1d73-f151-4868-8c3a-0aaa62d83be9 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.818720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.819316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.819590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.819856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.820530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:13.820824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.822191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.834459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 640/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:13.840299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.936394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37bcc8-88e2-4e55-accc-7268c9d08687 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.956523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.970018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.970648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.970923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.971187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.977794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.979209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:29:13.990205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:13.991324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:13.992563 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 627/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:13.997230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.097194 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c23d-f990-4c6f-b00b-122217db96c5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.130126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.130962 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.131235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.131506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.132220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:14.132520 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.133954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.142122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:14.150976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 641/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:14.156717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.252749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ebd3-1039-45f4-86a7-1b287294f6e0 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.284895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.285168 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.285459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.295311 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.296735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:14.310660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:14.311775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:14.312782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:14.312782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:14.312782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:14.312782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 628/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:14.318307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.413397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5290f-ed20-4415-96ce-7504fef7a49c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.446753 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.447339 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.447617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.447889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.448526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:14.448827 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.450206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.461043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 642/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:14.466573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.496774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:14.562476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c301b-99ad-4135-b7e1-78fd6ceb8c33 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.594841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.595450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.596256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.596526 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.602787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.604213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:29:14.615520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:14.616557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:14.617520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 629/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:14.622361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.677636 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:14.718784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc01d-ebd0-4bee-a853-11e8916c699c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.749963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.750537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.750808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.751074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.751750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:14.752574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.753999 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51166-95f9-4c6a-b59e-eca4a552c620 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.765621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 643/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:29:14.771473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:14.858267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:14.867570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1c12-356f-42cb-b48c-ea26fef1d268 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:14.899187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:14.899815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:14.900091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:14.900363 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] PATH_INFO: `/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/f526261ef68741719e636497d86446f7/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:14.902238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00ee2cb812c4f5195baea411a6f0e4e, user_id=f526261ef68741719e636497d86446f7, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:14.903650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ccd2a-c3ef-4331-bd47-d21d151783d3 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:14.915801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 630/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 30 09:29:14 2022] PUT /identity/v3/projects/d00ee2cb812c4f5195baea411a6f0e4e/users/f526261ef68741719e636497d86446f7/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:29:17.019810 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60f7b-39d1-4b0b-b267-e36054d822ea None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.020332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60f7b-39d1-4b0b-b267-e36054d822ea None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.020332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60f7b-39d1-4b0b-b267-e36054d822ea None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.021721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 644/1274] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:17.026824 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.027376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.045458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:17.046613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:17.118735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 631/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:17.387676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60f7b-39d1-4b0b-b267-e36054d822ea None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:17.485184 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60f7b-39d1-4b0b-b267-e36054d822ea None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:17.502448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:17.519252 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:17.519858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.520128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.520393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.529944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:17.534655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:17.535761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:17.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 645/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:17.541730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:17.620806 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:17.638693 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37d61d-5b3d-4b41-9893-17ebdc859a7a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:17.670601 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:17.671184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.671463 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.671729 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:17.672674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:17.674120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:17.681749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 632/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:17.687432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:17.784903 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19455fa-6f14-43f3-a660-782e31b56d1e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:17.817356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:17.817959 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.818239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.818510 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.828165 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:17.829619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:17.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:17.844674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:17.846220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:17.846220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:17.846220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:17.846220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 646/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:17.850870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:17.946444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e4fd5-cc9c-4782-89ff-a1370458bc6f None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:17.979467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:17.980058 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:17.980339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:17.980609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:17.981245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:17.981570 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:17.982927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:17.994279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 633/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:17.999956 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.030265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.097954 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f84e7d-fd06-4497-8326-d8bf62e8586c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.129519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.130125 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.130656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.130925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.138056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.139472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:29:18.151066 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:18.152183 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:18.153369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 647/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:18.157902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.162186 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.254144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f120-ac82-4223-869d-718e4fae5ac1 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.287505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.288092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.288366 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.288633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.289370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:18.289671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.291075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.307116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 634/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:18.313014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.401743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.412598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c30fe0-099e-445a-a9f1-eeb6f57f8116 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.445024 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.445637 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.445910 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.446181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.509392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.510762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.593478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.603879 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 648/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:18.609718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.668100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.704584 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6f1c-8288-4596-8f55-cee8092d5237 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.737000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.737626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.737900 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.738165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.747506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.748920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:18.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:18.765098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:29:18.766245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:18.766245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:29:18.766245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:18.766245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 635/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:18.770556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.864552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59f1c1-98df-4156-96f1-d4728c7085a5 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.897382 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.897960 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.898235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.898505 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.899137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:18.899437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.900774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.911565 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 649/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:18.916888 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:19.012658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c06c-53d0-452b-8dcc-d5f1b894b13a None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:19.025951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:19.046161 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:19.046764 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:19.047038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:19.047305 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:19.053565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:19.054983 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:29:19.066646 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:19.067689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: ERROR keystone.server.flask.application Sep 30 09:29:19.068915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 636/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:19.073649 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:19.121607 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:19.170459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115202-4e0c-48f5-abcd-cff63279c62c None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:19.202276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:19.202864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:19.203141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:19.203412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:19.204096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:19.204397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:19.206400 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9f6f-fec0-45d3-891c-c9138368075e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:19.217856 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 650/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 30 09:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:19.223795 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:19.318947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501743-ed38-4227-9e81-718dd072ec14 None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:19.350614 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:19.351185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:19.351458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:19.351728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:19.352434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] RBAC: Adding query filter params (role.id=fae19a3dd1304ccdaeae8710b6e07ce0, scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e, user.id=f526261ef68741719e636497d86446f7) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:19.352737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:19.354189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389faaa-6b2b-4ca8-ad59-914fde0f9e72 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:19.359622 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 637/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:19 2022] GET /identity/v3/role_assignments?user.id=f526261ef68741719e636497d86446f7&scope.project.id=d00ee2cb812c4f5195baea411a6f0e4e&role.id=fae19a3dd1304ccdaeae8710b6e07ce0 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:21.505539 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07d54-1f62-4c24-9267-4223d05367a5 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.506052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07d54-1f62-4c24-9267-4223d05367a5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.506175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f07d54-1f62-4c24-9267-4223d05367a5 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.507462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 651/1288] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:21.512497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.512912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.513042 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.530625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:21.531782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:21.560261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:21.596910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 638/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:21.864197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f07d54-1f62-4c24-9267-4223d05367a5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:21.963408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f07d54-1f62-4c24-9267-4223d05367a5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:21.974237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:21.996706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:21.997344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.997622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.998167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.998750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:22.000094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:22.008796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:22.010110 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:22.010975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 652/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:29:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:22.015838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:22.115941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de22af-833e-4b35-b3c2-aa27f7b76a59 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:22.151127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:22.151719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:22.151996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:22.152264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:22.152889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:22.153187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:22.154568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9250-dcb7-4ffe-ac4f-c985234eb6f2 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:22.159283 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 639/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 30 09:29:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:22.165034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:22.261037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95c59-4a5f-4526-b1bc-38ef0f765b4e None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:22.292958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:22.293555 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:22.293828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:22.294094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] PATH_INFO: `/v3/services` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:22.294718 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:22.295014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:22.296350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0350-415e-44e4-8353-ee00f85aeab8 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:22.300504 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 653/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 30 09:29:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:24.418909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14641-7115-4cf5-b884-6480e093e8cd None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.419383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14641-7115-4cf5-b884-6480e093e8cd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.419477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14641-7115-4cf5-b884-6480e093e8cd None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.420826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 640/1293] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:24.426733 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cac2-99b6-474f-9915-b87dc600cf7e None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.427112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cac2-99b6-474f-9915-b87dc600cf7e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.427277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cac2-99b6-474f-9915-b87dc600cf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.444850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-6d81cac2-99b6-474f-9915-b87dc600cf7e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:24.446042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6d81cac2-99b6-474f-9915-b87dc600cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:24.474175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:24.509817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 654/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:24.772749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14641-7115-4cf5-b884-6480e093e8cd None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:24.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:24.872522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14641-7115-4cf5-b884-6480e093e8cd None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:24.905111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:24.905747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.906024 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.906296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.906947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:24.908873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e670d-8ce8-49e9-b73c-69aeb38fa7e6 None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:24.922528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 641/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 30 09:29:24 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:29:27.075284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdff494-43ee-4c18-a2f1-73eec482d6d7 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.075838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdff494-43ee-4c18-a2f1-73eec482d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.075838 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdff494-43ee-4c18-a2f1-73eec482d6d7 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.078049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 655/1296] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:27.083957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.084388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.084512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.105002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:27.106270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:27.181728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 642/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:27.445985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdff494-43ee-4c18-a2f1-73eec482d6d7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:27.544177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdff494-43ee-4c18-a2f1-73eec482d6d7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:27.576834 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:27.577463 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.577742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.578012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.578595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:27.580559 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:27.589095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:27.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:27.591119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 656/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:29:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:27.596525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:27.614586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:27.692615 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf5d52-1ce2-4d47-b440-311f7cebaf10 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:27.724882 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:27.725494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.725770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.726037 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.726659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:27.726952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:27.728300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:27.733170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 643/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 30 09:29:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:27.739422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:27.770569 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:27.836214 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92b84-f694-47de-8413-4e87fd7d88d6 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:27.868467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:27.869051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.869351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.869619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.870307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] RBAC: Adding query filter params (interface=public, service_id=dd47d835dc164cee96d4350d1a2895da, region_id=RegionOne) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:27.870608 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:27.871938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5edb45-9dba-452f-8cca-7fa10327f64c None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:27.876753 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 657/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 30 09:29:27 2022] GET /identity/v3/endpoints?service_id=dd47d835dc164cee96d4350d1a2895da&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:27.882578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:27.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:27.978807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73a120-90e6-457d-bbde-de4d842af58c None admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.015847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.016442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.016726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.017002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.017625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:28.018971 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe436e-65b1-477c-9a86-73cd1591728e None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:28.025594 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 644/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 30 09:29:27 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:29:30.166283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d760-f10d-4bcb-aeef-f19a8ac6b947 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.166831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d760-f10d-4bcb-aeef-f19a8ac6b947 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.166831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d760-f10d-4bcb-aeef-f19a8ac6b947 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.168168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 658/1302] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:30.173408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.173833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.173955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.191629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:30.192831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:30.256184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 645/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:30.520761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d760-f10d-4bcb-aeef-f19a8ac6b947 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:30.612914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:30.620005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d760-f10d-4bcb-aeef-f19a8ac6b947 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:30.651796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:30.652399 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.652674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.652942 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.653546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:30.654885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:30.663805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:30.664944 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: ERROR keystone.server.flask.application Sep 30 09:29:30.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 659/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 30 09:29:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:29:30.670734 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:30.743426 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:30.765838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376786-380b-454d-9299-8ce21cb832c3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:30.798928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:30.799519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.799798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.800068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] PATH_INFO: `/v3/services` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.800689 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:30.800987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:30.802377 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ac989-23ac-4426-a082-60d646c18a2b None admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:30.807269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 646/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 30 09:29:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:30.813140 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:30.909168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9d84c-f0a8-4243-b65b-0ac20177a291 None admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:30.942275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:30.942862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.943143 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.943417 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.944086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:30.945472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e806390-a15b-4854-968e-67fce246eb86 None admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:30.964476 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 660/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:29:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:29:40.804748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=30 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:40.960719 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.211845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2ce0-be7a-47ff-80a6-b1167ae99d71 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.212337 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2ce0-be7a-47ff-80a6-b1167ae99d71 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.212420 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2ce0-be7a-47ff-80a6-b1167ae99d71 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.214031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 647/1307] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:34.219686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be014-33fa-4d18-9e98-a18f5942e3ff None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.220098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be014-33fa-4d18-9e98-a18f5942e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.220272 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be014-33fa-4d18-9e98-a18f5942e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.363918 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-fd1be014-33fa-4d18-9e98-a18f5942e3ff None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:34.365191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fd1be014-33fa-4d18-9e98-a18f5942e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:34.489445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 661/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:34.782117 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.782484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.782985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.784437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 648/1309] 10.222.0.25 () {54 vars in 964 bytes} [Fri Sep 30 09:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:34.790268 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1236a-2b08-42e6-a124-d402c782d4b5 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.790629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1236a-2b08-42e6-a124-d402c782d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.790977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1236a-2b08-42e6-a124-d402c782d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.874302 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-23a1236a-2b08-42e6-a124-d402c782d4b5 None None] MFA Rules not processed for user `6d02936fe7de42d7a441bdb0e0d60fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:34.875535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-23a1236a-2b08-42e6-a124-d402c782d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:34.897288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.962127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 662/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Fri Sep 30 09:30:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:34.972255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.974152 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:35.097474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061fffe-e2d6-4849-8fea-61ad22450f1a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.176462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.177055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.177356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.177625 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.179201 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:35.236516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:35.294022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.295474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10346fe6-ebfe-4443-b9c6-774b61648674 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.314741 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 649/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:30:37.797542 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:37.798141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:37.798141 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:37.799529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 663/1312] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:37.805004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e30d-ae6b-4fc7-9ccc-37644a5a7251 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:37.805462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e30d-ae6b-4fc7-9ccc-37644a5a7251 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:37.805687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e30d-ae6b-4fc7-9ccc-37644a5a7251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:37.875207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-6bc4e30d-ae6b-4fc7-9ccc-37644a5a7251 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:37.876522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-6bc4e30d-ae6b-4fc7-9ccc-37644a5a7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:37.973777 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 650/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:38.254791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:38.256340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:38.359028 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73f432-d464-4999-bd03-9cef0f541590 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:38.436325 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:38.438886 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:38.439562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:38.440025 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:38.440501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:38.442375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:38.549356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:38.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29711bbd-7f09-40ab-8c6e-f4b6fc0c6dba service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:38.568670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 664/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:41.025486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:41.026050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:41.026050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:41.027398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 651/1315] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:41.032605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d16-9dd7-42a4-8792-84023d4fc3cd None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:41.033041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d16-9dd7-42a4-8792-84023d4fc3cd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:41.033197 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d16-9dd7-42a4-8792-84023d4fc3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:41.102548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b1474d16-9dd7-42a4-8792-84023d4fc3cd None None] MFA Rules not processed for user `722876754eac470fb2750ddfe010bf80`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:41.103771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b1474d16-9dd7-42a4-8792-84023d4fc3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:41.155483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:41.198923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 665/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:41.486315 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:41.487841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:41.498902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:41.588817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa69c85-38fe-40f8-a2c8-b8b6598e705b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:41.661041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:41.661725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:41.662002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:41.662271 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:41.663826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:41.723384 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:41.769492 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:41.770912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11809d-680f-4d63-9fcc-1a6bbf8f180c service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:41.787975 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 652/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:30:44.438472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.438987 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.439096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.440375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 666/1318] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:44.445480 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3af9-5469-4a85-beb0-1f65da143bb4 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.445884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3af9-5469-4a85-beb0-1f65da143bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.446026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3af9-5469-4a85-beb0-1f65da143bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.509992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-00fa3af9-5469-4a85-beb0-1f65da143bb4 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:44.511175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-00fa3af9-5469-4a85-beb0-1f65da143bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:44.604038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 653/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:44.894830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:44.896390 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:44.998314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8325a18-5bbf-4a03-99e3-cc46335f5e6e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:45.070494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:45.071353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.071736 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.071901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.074157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:45.081948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:45.181507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:45.182852 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bee1da-6707-4c62-8d75-1ebc0512cec3 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:45.200860 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 667/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:47.994979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f5d4-a41c-4fdc-a103-06aee05084b8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:47.995504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f5d4-a41c-4fdc-a103-06aee05084b8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:47.995504 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f5d4-a41c-4fdc-a103-06aee05084b8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:47.997606 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 654/1321] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:48.003347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675025-0c68-4bb4-9903-0ef7cdf80687 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.003897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675025-0c68-4bb4-9903-0ef7cdf80687 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.003897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675025-0c68-4bb4-9903-0ef7cdf80687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.079374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2f675025-0c68-4bb4-9903-0ef7cdf80687 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:48.080605 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2f675025-0c68-4bb4-9903-0ef7cdf80687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.142846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.184623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 668/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:48.490194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.490484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.490758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.492112 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 655/1323] 10.222.0.25 () {54 vars in 964 bytes} [Fri Sep 30 09:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:48.498254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e370a-4f8d-4001-94e4-f3c0e6f53e55 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.498541 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e370a-4f8d-4001-94e4-f3c0e6f53e55 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.498843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e370a-4f8d-4001-94e4-f3c0e6f53e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.575540 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-474e370a-4f8d-4001-94e4-f3c0e6f53e55 None None] MFA Rules not processed for user `6d02936fe7de42d7a441bdb0e0d60fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:48.576732 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-474e370a-4f8d-4001-94e4-f3c0e6f53e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.657757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 669/1324] 10.222.0.25 () {58 vars in 1061 bytes} [Fri Sep 30 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:48.666874 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:48.669009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.688072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.770363 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fa605-503e-4a9a-bbe0-7e531cdc92c3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:48.842894 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:48.843495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.843767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.844034 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.845645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.915013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.951370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:48.952804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f7ebc-0bd4-4e1d-882a-d994aafcc28e service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:48.970947 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 656/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:51.385590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:51.386121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:51.386121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:51.387984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 670/1326] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:30:51.393495 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606569-5020-4565-b37d-a5329070ea71 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:51.393899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606569-5020-4565-b37d-a5329070ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:51.394036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606569-5020-4565-b37d-a5329070ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:51.463913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-27606569-5020-4565-b37d-a5329070ea71 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:51.465115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-27606569-5020-4565-b37d-a5329070ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:51.560469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 657/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:51.840817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:51.842434 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:51.905714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:51.945870 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5cbb0-5f75-4173-8782-a564be5ef080 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:52.018138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:52.019123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:52.019408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:52.019682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:52.021283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:52.127481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:52.130530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:52.131972 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7889c-f971-4ca6-9435-0edd37ddba44 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:52.150138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 671/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:54.375206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.375724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.375724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.377078 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 658/1329] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:54.382912 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457096-0d54-45df-92a7-cd026099ae6c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.383364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457096-0d54-45df-92a7-cd026099ae6c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.383455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457096-0d54-45df-92a7-cd026099ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.453721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2c457096-0d54-45df-92a7-cd026099ae6c None None] MFA Rules not processed for user `722876754eac470fb2750ddfe010bf80`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:54.454961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2c457096-0d54-45df-92a7-cd026099ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:54.557062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 672/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:54.838272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.839890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:54.870590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.942252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207dc57-b1e3-42fb-a9a1-7a9245d03e46 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:55.017408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:55.018004 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:55.018276 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:55.018543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:55.020115 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:55.102047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:55.135297 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:55.137349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f76dd-68f4-4d73-8936-7498b2edbb93 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:55.156859 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 659/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:57.512277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.512829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.512829 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.514200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 673/1332] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:57.519469 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46d1d-c9f2-4a1d-9214-5a8bb5a7a4c1 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.519841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46d1d-c9f2-4a1d-9214-5a8bb5a7a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.520016 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46d1d-c9f2-4a1d-9214-5a8bb5a7a4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.584286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-03b46d1d-c9f2-4a1d-9214-5a8bb5a7a4c1 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:57.585803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-03b46d1d-c9f2-4a1d-9214-5a8bb5a7a4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:57.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 660/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:57.968406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:57.971096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:58.042622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.077221 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c7844-cc1d-4028-bf52-b5d7a7605683 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.148566 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.149159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.149466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.149740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.151309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:58.259255 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.260610 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc266df7-97f2-462e-9c4e-771be273bc5a service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.271458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.279682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 674/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:00.450041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:00.450541 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:00.450648 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:00.451917 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 661/1335] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:00.457179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15020e0-4125-4148-af08-5d442e39a78f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:00.457623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15020e0-4125-4148-af08-5d442e39a78f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:00.457766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15020e0-4125-4148-af08-5d442e39a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:00.523199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d15020e0-4125-4148-af08-5d442e39a78f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:00.524396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d15020e0-4125-4148-af08-5d442e39a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:00.618797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 675/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:00.903443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:00.904957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:00.944740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:01.006010 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefc58-968d-4094-9bc1-fe6dbe422fe6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:01.081015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:01.081638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:01.081918 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:01.082189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:01.083761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:01.165393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:01.190656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:01.192090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc54ca-d383-47f4-bd5f-01f8b4171fd0 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:01.209367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 662/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:03.663332 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:03.663837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:03.663837 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:03.665139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 676/1338] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:03.670329 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806429b-f98f-4b54-b533-9a542141fb15 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:03.670725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806429b-f98f-4b54-b533-9a542141fb15 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:03.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806429b-f98f-4b54-b533-9a542141fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:03.735162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4806429b-f98f-4b54-b533-9a542141fb15 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:03.736356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4806429b-f98f-4b54-b533-9a542141fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:03.828973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 663/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:04.108782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:04.110351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:04.186047 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:04.212432 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4d0d-e3b7-4960-b253-386b14a8c7ff None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:04.284839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:04.285462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:04.285742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:04.286011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:04.287579 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:04.395709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:04.397059 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1079d77-9a46-4120-9284-e927d0dba242 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:04.415222 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 677/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:08.811522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.812068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.812068 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.813587 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 664/1341] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:08.819168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e645-a72f-48fe-887f-1eefb4624ac8 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.819168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e645-a72f-48fe-887f-1eefb4624ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.819681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e645-a72f-48fe-887f-1eefb4624ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.825435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:08.888560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d040e645-a72f-48fe-887f-1eefb4624ac8 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:08.889792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d040e645-a72f-48fe-887f-1eefb4624ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:08.992627 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 678/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:31:09.286918 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:09.288798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:09.338465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:09.393674 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179dee3-a568-4ef5-b9cb-0ddaedaa949d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:09.467310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:09.467887 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:09.468160 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:09.468425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:09.470019 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:09.562419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:09.579855 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:09.581351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108b134-269b-45b8-8fd5-2fdc1caa12f4 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:09.599984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 665/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:12.403251 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:12.403800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:12.403800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:12.408818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 679/1344] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:12.410509 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155bf7-2904-4c6c-8bd4-d6493c3b6319 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:12.410935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155bf7-2904-4c6c-8bd4-d6493c3b6319 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:12.411087 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155bf7-2904-4c6c-8bd4-d6493c3b6319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:12.475171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2e155bf7-2904-4c6c-8bd4-d6493c3b6319 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:12.476367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2e155bf7-2904-4c6c-8bd4-d6493c3b6319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:12.575150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 666/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:12.860391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:12.862203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:12.960497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:12.978581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb28c3-20e5-45ee-924d-b2e41b3ffac7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:13.055319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:13.055932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:13.056206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:13.056479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:13.058655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:13.178757 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:13.180204 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef0fa-748c-4555-8c17-492d15fc8bd8 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:13.199726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 680/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:17.551562 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:17.552014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:17.552111 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:17.553520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 667/1347] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:17.559647 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e94ec-7bd1-4d41-959a-223d50826ae4 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:17.560093 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e94ec-7bd1-4d41-959a-223d50826ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:17.560190 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e94ec-7bd1-4d41-959a-223d50826ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:17.575435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:17.626945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-399e94ec-7bd1-4d41-959a-223d50826ae4 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:17.628397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-399e94ec-7bd1-4d41-959a-223d50826ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:17.723173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 681/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:18.001667 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:18.003461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:18.061022 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:18.110465 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd75a4-7ab0-49bf-8516-da12cd3a5e49 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:18.187100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:18.187705 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:18.187982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:18.188257 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:18.189860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:18.294221 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:18.298841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:18.300286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ce60-4dc6-4033-8d7c-ce2fe3ebd40d service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:18.318963 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 668/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:23.121116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af0d0-a96a-4cab-8a3b-edb351014dee None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:23.121672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af0d0-a96a-4cab-8a3b-edb351014dee None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:23.121796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af0d0-a96a-4cab-8a3b-edb351014dee None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:23.123341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 682/1350] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:23.128424 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725390fb-ed1c-46db-8dce-22d12591f4f6 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:23.128800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725390fb-ed1c-46db-8dce-22d12591f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:23.128979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725390fb-ed1c-46db-8dce-22d12591f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:23.240703 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-725390fb-ed1c-46db-8dce-22d12591f4f6 None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:23.242125 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-725390fb-ed1c-46db-8dce-22d12591f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:23.377515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 669/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:27.514867 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639c3e-400e-4cef-87b5-562050920efd None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:27.515824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639c3e-400e-4cef-87b5-562050920efd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:27.516303 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639c3e-400e-4cef-87b5-562050920efd None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:27.518023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 683/1352] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:27.523220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4dbf-f8d5-4407-8f15-18e9186c7d77 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:27.523637 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4dbf-f8d5-4407-8f15-18e9186c7d77 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:27.523798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4dbf-f8d5-4407-8f15-18e9186c7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:27.580025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:27.603800 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-5bfc4dbf-f8d5-4407-8f15-18e9186c7d77 None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:27.605006 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5bfc4dbf-f8d5-4407-8f15-18e9186c7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:27.720783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 670/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:27.721586 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=59 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:29.104227 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5632-ddbc-47f6-b54c-88ec01ee2d47 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:29.104899 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5632-ddbc-47f6-b54c-88ec01ee2d47 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:29.104899 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5632-ddbc-47f6-b54c-88ec01ee2d47 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:29.106951 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 684/1354] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:29.111990 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78317-022c-4aa8-8057-a7f421ed288f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:29.112433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78317-022c-4aa8-8057-a7f421ed288f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:29.112527 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78317-022c-4aa8-8057-a7f421ed288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:29.191798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-46e78317-022c-4aa8-8057-a7f421ed288f None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:29.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-46e78317-022c-4aa8-8057-a7f421ed288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:29.235996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:29.300496 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 671/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:31:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:32.918155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982be8a-827c-40e6-9a11-680feb2b6368 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:32.918672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982be8a-827c-40e6-9a11-680feb2b6368 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:32.918672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982be8a-827c-40e6-9a11-680feb2b6368 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:32.919948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 685/1356] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:32.925791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f7e4-ead3-4f05-b178-ff45d4086e2d None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:32.926238 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f7e4-ead3-4f05-b178-ff45d4086e2d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:32.926348 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f7e4-ead3-4f05-b178-ff45d4086e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:32.999166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-6780f7e4-ead3-4f05-b178-ff45d4086e2d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:33.000355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-6780f7e4-ead3-4f05-b178-ff45d4086e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:33.101313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 672/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:33.410159 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:33.410446 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:33.410727 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:33.412061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 686/1358] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:33.421575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c54b-8b0c-49a3-a5e5-e2032f5019a7 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:33.422012 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c54b-8b0c-49a3-a5e5-e2032f5019a7 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:33.422400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c54b-8b0c-49a3-a5e5-e2032f5019a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:33.439209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:33.508096 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-1a21c54b-8b0c-49a3-a5e5-e2032f5019a7 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:33.510140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1a21c54b-8b0c-49a3-a5e5-e2032f5019a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:33.639272 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 673/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:31:33.647271 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:33.648936 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:33.800308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57f708-8ed3-45f5-9694-f92b78ab841d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:33.875911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:33.917198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:33.917874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:33.918275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:33.918851 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:33.920357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:34.026814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:34.028437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d22a-7861-40be-8ed0-7350564fca8f service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:34.048019 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 687/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:36.440609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:36.440609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:36.440609 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:36.444572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 674/1361] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:36.445870 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33cf81-4fad-47df-ac9d-9663929d499d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:36.446340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33cf81-4fad-47df-ac9d-9663929d499d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:36.446340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33cf81-4fad-47df-ac9d-9663929d499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:36.532048 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-5e33cf81-4fad-47df-ac9d-9663929d499d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:36.533403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-5e33cf81-4fad-47df-ac9d-9663929d499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:36.573927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:36.635833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 688/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:36.928781 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:36.930538 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:36.999089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:37.101286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b33de-6ddb-41ec-87e1-2cf5cc5f6a29 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:37.223735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:37.224338 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:37.224613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:37.224884 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:37.226572 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:37.250288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:37.323158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:37.324780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1cef-a0f1-4342-8370-4d47abf7f941 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:37.343877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 675/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:39.813153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608e49-1200-49ec-b1d3-1517249b97f9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:39.813771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608e49-1200-49ec-b1d3-1517249b97f9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:39.813771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608e49-1200-49ec-b1d3-1517249b97f9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:39.815237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 689/1364] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:39.820173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da307-7c3d-414e-8d67-7be4ece5e363 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:39.820613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da307-7c3d-414e-8d67-7be4ece5e363 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:39.820704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da307-7c3d-414e-8d67-7be4ece5e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:39.890156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-290da307-7c3d-414e-8d67-7be4ece5e363 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:39.891353 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-290da307-7c3d-414e-8d67-7be4ece5e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:39.989930 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:39.993093 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 676/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:40.284596 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:40.284904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:40.285198 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:40.286847 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 690/1366] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:40.293081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8d9e-92c1-4c20-8f44-276797b6b9ae None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:40.293468 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8d9e-92c1-4c20-8f44-276797b6b9ae None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:40.293805 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8d9e-92c1-4c20-8f44-276797b6b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:40.371724 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-dd6a8d9e-92c1-4c20-8f44-276797b6b9ae None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:40.372991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-dd6a8d9e-92c1-4c20-8f44-276797b6b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:40.501415 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 677/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:40.508923 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:40.510585 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:40.660254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423cd52-7228-4f6f-8a1e-bf0db4252b67 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:40.681650 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:40.779811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:40.781178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:40.781178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:40.781178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:40.788323 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:40.885711 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:40.887467 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7489-a163-4292-ace7-7e6ac8574fe1 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:40.912160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 691/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:31:41.048461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea076c9-7758-4699-b1b9-661f0f29cdeb None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:41.049050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea076c9-7758-4699-b1b9-661f0f29cdeb None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:41.049439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea076c9-7758-4699-b1b9-661f0f29cdeb None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:41.051387 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 678/1369] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:41.058175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d27b4-83eb-46c5-97e1-51b9253d9e38 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:41.058497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d27b4-83eb-46c5-97e1-51b9253d9e38 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:41.059015 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d27b4-83eb-46c5-97e1-51b9253d9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:41.098005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:41.141051 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a06d27b4-83eb-46c5-97e1-51b9253d9e38 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:41.142418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a06d27b4-83eb-46c5-97e1-51b9253d9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:41.256245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 692/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:41.594099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:41.594099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:41.594099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:41.597442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 679/1371] 10.222.0.25 () {54 vars in 963 bytes} [Fri Sep 30 09:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:41.599646 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b48d-0cb9-4ddc-b392-9de5619c3167 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:41.599932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b48d-0cb9-4ddc-b392-9de5619c3167 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:41.600207 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b48d-0cb9-4ddc-b392-9de5619c3167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:41.681069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-21b3b48d-0cb9-4ddc-b392-9de5619c3167 None None] MFA Rules not processed for user `50516a9eb95f42129b257c5b71b782a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:41.682305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-21b3b48d-0cb9-4ddc-b392-9de5619c3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:41.733669 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:41.765598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 693/1372] 10.222.0.25 () {58 vars in 1060 bytes} [Fri Sep 30 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:41.773461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:41.775530 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:41.831267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:41.889816 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2e98-730d-44b9-8b0b-683f89face07 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:41.980287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50516a9eb95f42129b257c5b71b782a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:41.980903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:41.981176 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:41.981476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:41.983208 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:42.112327 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:42.130060 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:42.131585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fa916-964f-498e-9333-1c04faf49870 service cinder] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:42.151613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 680/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:43.150478 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:43.151061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:43.151061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:43.152376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 694/1374] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:43.157662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c370-508e-4fa3-a6ce-941868d28ddb None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:43.158108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c370-508e-4fa3-a6ce-941868d28ddb None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:43.158214 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c370-508e-4fa3-a6ce-941868d28ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:43.222842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-fa72c370-508e-4fa3-a6ce-941868d28ddb None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:43.224033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fa72c370-508e-4fa3-a6ce-941868d28ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:43.325025 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 681/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:43.617144 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:43.619344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:43.781676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04f5d5-26a1-464f-8ea2-f420901d7b47 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:43.833791 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:43.897664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:43.898272 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:43.898548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:43.898816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:43.900913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:43.992612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:43.994304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c1f65-4435-4dd9-917e-15a95acf5edd service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:44.012777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 695/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:46.204287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:46.205144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:46.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:46.206951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 682/1377] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:46.212800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd30eb-53d6-414d-9a0a-a92b55cbf027 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:46.213231 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd30eb-53d6-414d-9a0a-a92b55cbf027 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:46.213494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd30eb-53d6-414d-9a0a-a92b55cbf027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:46.281715 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-cdcd30eb-53d6-414d-9a0a-a92b55cbf027 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:46.283072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-cdcd30eb-53d6-414d-9a0a-a92b55cbf027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:46.290738 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:46.388438 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 696/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:46.675267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:46.676933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:46.741212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:46.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15308126-df5b-4065-b06e-7dda740629d0 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:46.954974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:46.955775 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:46.956166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:46.956544 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:46.958245 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:46.978630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:47.053030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:47.054794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449687f0-2ad5-4728-814a-8891decb1724 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:47.073284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 683/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:49.291803 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:49.292377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:49.292377 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:49.293975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 697/1380] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:49.299046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4c55-cb21-4cdd-8405-e35141fc6a5e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:49.299462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4c55-cb21-4cdd-8405-e35141fc6a5e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:49.299720 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4c55-cb21-4cdd-8405-e35141fc6a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:49.367393 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c54a4c55-cb21-4cdd-8405-e35141fc6a5e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:49.368630 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c54a4c55-cb21-4cdd-8405-e35141fc6a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:49.465586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:49.472031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 684/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:49.772916 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:49.775164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:49.915082 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:49.925981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e26a0b-9630-4123-b897-fc4ebd6d83ff None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:50.041086 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:50.041712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:50.041991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:50.042320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:50.043857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:50.135219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:50.136802 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd7fee-55b6-4007-8750-30437d2768a3 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:50.146657 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:50.155695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 698/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:31:52.348890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:52.349467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:52.349467 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:52.350796 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 685/1383] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:31:52.356259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e000d7-9b7a-48c6-a8ce-ca7aac88198f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:52.356675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e000d7-9b7a-48c6-a8ce-ca7aac88198f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:52.356808 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e000d7-9b7a-48c6-a8ce-ca7aac88198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:52.432186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-56e000d7-9b7a-48c6-a8ce-ca7aac88198f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:52.433418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-56e000d7-9b7a-48c6-a8ce-ca7aac88198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:52.531614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 699/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:31:52.818113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:52.819662 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:52.970933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d67e8-7488-4b63-95f9-8c8e28b0224b None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:53.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:53.092197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:53.092656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:53.092931 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:53.093197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:53.094973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:53.185113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:53.186773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15563b-7e4f-4de0-80dd-731c58e3055a service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:53.204350 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 686/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:55.431102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:55.431606 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:55.431702 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:55.433002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 700/1386] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:55.438286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82bc0c-c015-402c-a808-eeca89930e84 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:55.438713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82bc0c-c015-402c-a808-eeca89930e84 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:55.438833 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82bc0c-c015-402c-a808-eeca89930e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:55.504167 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-6f82bc0c-c015-402c-a808-eeca89930e84 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:55.505399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-6f82bc0c-c015-402c-a808-eeca89930e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:55.538215 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:55.604753 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 687/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:55.898846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:55.900337 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:55.978743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:56.046892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39f315-5135-4a4d-9448-40c0c5a7f5ef None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:56.161932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:56.162448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:56.162726 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:56.162995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:56.165089 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:56.203713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:56.256619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:56.258275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee30534-ab55-4513-b178-e05ec3e1e67f service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:56.276037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 701/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:57.351369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb806bd-a5bf-48a2-a232-00289a8dc1e8 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:57.351980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb806bd-a5bf-48a2-a232-00289a8dc1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:57.351980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb806bd-a5bf-48a2-a232-00289a8dc1e8 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:57.353426 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 688/1389] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:57.358618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef51f-4c4c-4ef7-a07f-0bef8bf96a80 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:57.359131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef51f-4c4c-4ef7-a07f-0bef8bf96a80 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:57.359131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef51f-4c4c-4ef7-a07f-0bef8bf96a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:57.428817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-aa9ef51f-4c4c-4ef7-a07f-0bef8bf96a80 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:57.430055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-aa9ef51f-4c4c-4ef7-a07f-0bef8bf96a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:57.528766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 702/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:57.825550 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:57.825840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:57.826113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:57.827453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 689/1391] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 30 09:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:57.832635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048be6-2773-4d3f-ade9-853b37efe6b8 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:57.832926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048be6-2773-4d3f-ade9-853b37efe6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:57.833199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048be6-2773-4d3f-ade9-853b37efe6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:57.849654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:57.910784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-43048be6-2773-4d3f-ade9-853b37efe6b8 None None] MFA Rules not processed for user `7fa68549998f496ca54350b3bcec0bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:57.911977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-43048be6-2773-4d3f-ade9-853b37efe6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:57.987312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 703/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 30 09:31:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:57.996212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:57.997723 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:58.102687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7b22-7b01-47a1-bae7-e9ebdccfa937 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:58.161116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:58.177532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fa68549998f496ca54350b3bcec0bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:58.178137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:58.178411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:58.178678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:58.180782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:58.296095 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:58.297710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d9f1-8f83-4ac0-a6d4-ad2f422a310b service glance] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:58.315294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 690/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:58.468017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:58.468614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:58.468735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:58.470211 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 704/1394] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:58.475901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608163-0c66-4306-a830-6e18422bea75 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:58.476316 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608163-0c66-4306-a830-6e18422bea75 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:58.476458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608163-0c66-4306-a830-6e18422bea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:58.548712 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b5608163-0c66-4306-a830-6e18422bea75 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:58.549993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b5608163-0c66-4306-a830-6e18422bea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:58.596835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:58.657297 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 691/1395] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:31:58.954007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:58.955664 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.064991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:59.094452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494ffc-05ef-4c49-ab6b-4ad55e0915b5 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:59.094735 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494ffc-05ef-4c49-ab6b-4ad55e0915b5 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:59.095003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494ffc-05ef-4c49-ab6b-4ad55e0915b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:59.116925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39328-bec2-41a8-ba2d-0f80edfba973 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:59.161578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-77494ffc-05ef-4c49-ab6b-4ad55e0915b5 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:59.162776 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-77494ffc-05ef-4c49-ab6b-4ad55e0915b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.232706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:59.233372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:59.233652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:59.233925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:59.235529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.249709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 692/1396] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:31:59.299462 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98af9-1839-4f3e-93b8-4ee685355dcd None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:59.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98af9-1839-4f3e-93b8-4ee685355dcd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:59.300018 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98af9-1839-4f3e-93b8-4ee685355dcd None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:59.301370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 693/1397] 10.222.0.25 () {54 vars in 943 bytes} [Fri Sep 30 09:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:31:59.308090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd429-5173-4b77-ad2e-816c11954a3f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:59.308445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd429-5173-4b77-ad2e-816c11954a3f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:59.308776 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd429-5173-4b77-ad2e-816c11954a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:59.311345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:59.331641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:59.333275 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:59.350554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:59.350846 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 705/1398] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:59.387525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b4ecd429-5173-4b77-ad2e-816c11954a3f None None] MFA Rules not processed for user `bf7c613ffbc6445296b63c1083ac8357`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:59.388707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b4ecd429-5173-4b77-ad2e-816c11954a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.504487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 694/1399] 10.222.0.25 () {58 vars in 1040 bytes} [Fri Sep 30 09:31:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:31:59.515391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:59.516617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.617203 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af075a4-4599-477e-a1ab-afd0cf3c9800 service nova] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:59.719007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:59.720415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:59.721028 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:59.721336 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:59.721896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:59.724150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:59.806512 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:59.808118 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ab7d-08fb-44f5-abbb-f8c7127cffd7 service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:59.816069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 706/1400] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:32:01.560311 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128699b-3b92-4268-a409-30883a14a33a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:01.560864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128699b-3b92-4268-a409-30883a14a33a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:01.560864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128699b-3b92-4268-a409-30883a14a33a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:01.562650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 695/1401] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:01.568062 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15792a1-1b5f-4fd8-9070-a5f001d17310 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:01.568884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15792a1-1b5f-4fd8-9070-a5f001d17310 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:01.569428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15792a1-1b5f-4fd8-9070-a5f001d17310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:01.642244 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f15792a1-1b5f-4fd8-9070-a5f001d17310 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:01.643818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f15792a1-1b5f-4fd8-9070-a5f001d17310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:01.745372 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:01.761419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 707/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:02.057516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128699b-3b92-4268-a409-30883a14a33a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:02.059344 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-a128699b-3b92-4268-a409-30883a14a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:02.159604 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:02.227593 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128699b-3b92-4268-a409-30883a14a33a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:02.349619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:02.350220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:02.350496 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:02.350767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:02.352877 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:02.419961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:02.460826 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:02.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816f8c4-915e-43ab-ad6e-858f667b5948 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:02.482444 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 696/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:04.759314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718508b9-3489-487a-baeb-69350094223f None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:04.759868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718508b9-3489-487a-baeb-69350094223f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:04.759868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718508b9-3489-487a-baeb-69350094223f None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:04.761280 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 708/1404] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:04.770028 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec762-7ab2-4473-b855-fb012947e8ee None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:04.770869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec762-7ab2-4473-b855-fb012947e8ee None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:04.771145 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec762-7ab2-4473-b855-fb012947e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:04.960275 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-f0aec762-7ab2-4473-b855-fb012947e8ee None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:04.961974 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f0aec762-7ab2-4473-b855-fb012947e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:05.062890 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 697/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:05.351094 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718508b9-3489-487a-baeb-69350094223f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:05.353137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-718508b9-3489-487a-baeb-69350094223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:05.521818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718508b9-3489-487a-baeb-69350094223f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:05.592602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:05.645058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:05.645795 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:05.646085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:05.646341 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:05.650213 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:05.745423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:05.747137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b128-2da5-401b-a82f-e819af7cf337 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:05.767151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 709/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:07.954578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:07.954992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:07.955253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:07.961105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 698/1407] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:32:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:07.962768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af93-897d-42ad-be02-8ad03edff9ea None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:07.963656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af93-897d-42ad-be02-8ad03edff9ea None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:07.963995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af93-897d-42ad-be02-8ad03edff9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:08.041436 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9883af93-897d-42ad-be02-8ad03edff9ea None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:08.041436 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9883af93-897d-42ad-be02-8ad03edff9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:08.073122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:08.148314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 710/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:32:08.433442 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:08.434942 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:08.474633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:08.596104 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51082961-ea88-458c-a6e4-7a6be92db04a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:08.777105 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:08.784783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:08.785419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:08.785700 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:08.785967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:08.787573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:08.897634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:08.899139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b03e-93cd-40d4-9a64-3b4dfd8559cb service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:08.919282 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 699/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:18.146440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=30 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:18.917118 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=48 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:22.632217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaeabb-ba7d-4845-9e2d-d888509fcd73 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.632755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaeabb-ba7d-4845-9e2d-d888509fcd73 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.632755 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaeabb-ba7d-4845-9e2d-d888509fcd73 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.634148 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 711/1410] 10.222.0.25 () {54 vars in 918 bytes} [Fri Sep 30 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:32:22.639203 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43188-3535-4e26-88df-6f7d2d236393 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.639628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43188-3535-4e26-88df-6f7d2d236393 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.639732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43188-3535-4e26-88df-6f7d2d236393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.714968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-5aa43188-3535-4e26-88df-6f7d2d236393 None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:22.716075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5aa43188-3535-4e26-88df-6f7d2d236393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:22.818252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 700/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 30 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:22.832570 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67893705-a403-4aec-a49c-8429e4e9220c None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.832880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67893705-a403-4aec-a49c-8429e4e9220c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.833155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67893705-a403-4aec-a49c-8429e4e9220c None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.834544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 712/1412] 10.222.0.25 () {54 vars in 918 bytes} [Fri Sep 30 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:22.839298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8fc7-9578-4f49-9033-4fe565df1112 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.839586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8fc7-9578-4f49-9033-4fe565df1112 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.839863 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8fc7-9578-4f49-9033-4fe565df1112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.911707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:22.914263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c0dd8fc7-9578-4f49-9033-4fe565df1112 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:22.916098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c0dd8fc7-9578-4f49-9033-4fe565df1112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:23.029912 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 701/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 30 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:32:25.609671 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:25.610201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:25.610201 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:25.611561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:25.616899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc46fc-88ee-49ba-952a-853d4b9deaa6 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:25.617359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc46fc-88ee-49ba-952a-853d4b9deaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:25.617457 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc46fc-88ee-49ba-952a-853d4b9deaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:25.681934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-49dc46fc-88ee-49ba-952a-853d4b9deaa6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:25.682965 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-49dc46fc-88ee-49ba-952a-853d4b9deaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:25.739140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:25.780810 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:26.073067 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:26.074663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:26.221564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce97fd-df97-42d4-8501-7b34e0f84942 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:26.296090 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:26.337904 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:26.338498 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:26.339036 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:26.339310 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:26.340889 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:26.436475 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:26.438119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19a07-510c-4702-9a38-26ef595ce2f5 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:26.455758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 714/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:27.608515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:27.609072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:27.609072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:27.610407 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:27.616572 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d90a2-0e0e-4fd4-81e0-9141a051b25d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:27.616971 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d90a2-0e0e-4fd4-81e0-9141a051b25d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:27.617109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d90a2-0e0e-4fd4-81e0-9141a051b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:27.691601 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-ea6d90a2-0e0e-4fd4-81e0-9141a051b25d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:27.692721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ea6d90a2-0e0e-4fd4-81e0-9141a051b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:27.720162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:27.804563 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:27.955103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:27.956503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:28.106119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8524153-a106-4489-9eec-75244ade2e3e None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:28.144634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:28.215383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:28.215952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:28.216209 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:28.216478 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:28.218087 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:28.305899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:28.307472 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511a12-bba5-40d6-a3bc-875fd81d539b service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:28.324613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 704/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:29.475439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:29.476029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:29.476029 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:29.477913 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:29.483989 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97adc-3b58-49f3-a60f-bfdeaea75549 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:29.484438 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97adc-3b58-49f3-a60f-bfdeaea75549 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:29.484542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97adc-3b58-49f3-a60f-bfdeaea75549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:29.538452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:29.561702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-69b97adc-3b58-49f3-a60f-bfdeaea75549 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:29.562905 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-69b97adc-3b58-49f3-a60f-bfdeaea75549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:29.658248 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:29.807743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:29.809309 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:29.951635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc5e8-b639-4ad3-87d3-40a4febfe6a9 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:29.963922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:30.063116 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:30.063709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:30.063986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:30.064254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:30.065839 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:30.154155 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:30.155786 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb455b8f-3375-49c1-a6be-13fc476e27b0 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:30.173031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 717/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:31.273421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:31.274436 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:31.274436 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:31.275725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:31.282149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a64b1-aff0-4129-b8d8-640dff2de7c6 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:31.282588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a64b1-aff0-4129-b8d8-640dff2de7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:31.282720 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a64b1-aff0-4129-b8d8-640dff2de7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:31.302698 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:31.358495 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-067a64b1-aff0-4129-b8d8-640dff2de7c6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:31.359688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-067a64b1-aff0-4129-b8d8-640dff2de7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:31.455881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:31.603730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:31.605283 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:31.712760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:31.747745 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1db49a-1d38-4da6-a4aa-d52c0e22b8a5 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:31.856960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:31.857505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:31.857787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:31.858059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:31.859633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:31.935113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:31.949092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:31.950697 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05779f9-9300-443a-82d3-0dd000438802 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:31.968087 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 707/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:33.072206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:33.072797 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:33.072928 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:33.074806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:33.081213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c0a1-2336-44f9-97ee-6633ac4e3760 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:33.081728 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c0a1-2336-44f9-97ee-6633ac4e3760 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:33.081834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c0a1-2336-44f9-97ee-6633ac4e3760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:33.157401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-da81c0a1-2336-44f9-97ee-6633ac4e3760 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:33.158600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-da81c0a1-2336-44f9-97ee-6633ac4e3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:33.252928 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:33.409812 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:33.411324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:33.500272 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:33.562961 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f5241-a856-4882-aa9a-5ff41ffcd11e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:33.674061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:33.674660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:33.674941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:33.675216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:33.676807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:33.725186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:33.766292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:33.767891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f0ae-3ba6-44a9-bc62-303d16225a09 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:33.785750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 720/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:34.831737 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:34.832300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:34.832300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:34.833660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:34.840339 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61fa-eca3-4e4d-abb7-67fbfcb82d31 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:34.840766 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61fa-eca3-4e4d-abb7-67fbfcb82d31 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:34.840873 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61fa-eca3-4e4d-abb7-67fbfcb82d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:34.916966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-079a61fa-eca3-4e4d-abb7-67fbfcb82d31 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:34.918128 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-079a61fa-eca3-4e4d-abb7-67fbfcb82d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:35.011965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:35.159675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:35.161220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:35.209793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:35.304402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148115-4bf1-433f-bdab-686b23c192d2 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:35.415392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:35.415993 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:35.416271 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:35.416595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:35.418216 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:35.425129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:35.505941 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:35.507431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257de45-a77f-4cb1-9ccf-e52693dd66db service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:35.525688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 710/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:36.574516 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:36.575079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:36.575079 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:36.576413 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:36.582749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5056d5-5083-4e5c-b05c-323a73e16ad6 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:36.583165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5056d5-5083-4e5c-b05c-323a73e16ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:36.583291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5056d5-5083-4e5c-b05c-323a73e16ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:36.657595 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2c5056d5-5083-4e5c-b05c-323a73e16ad6 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:36.658780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2c5056d5-5083-4e5c-b05c-323a73e16ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:36.724369 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:36.753321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:36.903112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:36.904612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:36.922005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:37.048635 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d5e10-dc46-4210-b808-a07a1ef5a990 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:37.135932 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:37.161489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:37.162139 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:37.162425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:37.162701 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:37.164296 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:37.253821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:37.255440 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6535e4-fa12-4505-bfbe-e8280a99bc7d service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:37.273857 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 723/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:38.316041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:38.316592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:38.316592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:38.317975 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:38.324645 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595104ca-5b33-4793-8b6b-8530807afd5f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:38.325098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595104ca-5b33-4793-8b6b-8530807afd5f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:38.325210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595104ca-5b33-4793-8b6b-8530807afd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:38.401162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-595104ca-5b33-4793-8b6b-8530807afd5f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:38.402423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-595104ca-5b33-4793-8b6b-8530807afd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:38.443331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:38.497264 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:38.647870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:38.649379 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:38.789832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012a0d-472f-4f74-a4b6-785118a9d633 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:38.842309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:38.906092 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:38.906634 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:38.906914 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:38.907269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:38.909214 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:38.997972 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:38.999554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df0260-9ee9-4f75-85df-20ea5fe1743a service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:39.017244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 713/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:40.057409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:40.057929 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:40.058043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:40.059327 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:40.065287 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c671a-b0d6-4892-81b5-78ed0ba9b5d9 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:40.065722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c671a-b0d6-4892-81b5-78ed0ba9b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:40.066140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c671a-b0d6-4892-81b5-78ed0ba9b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:40.141192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-d78c671a-b0d6-4892-81b5-78ed0ba9b5d9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:40.142455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d78c671a-b0d6-4892-81b5-78ed0ba9b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.144425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:40.237560 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:40.387453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:40.388946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.534396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f92c-3680-403e-83da-f7345ab1c18f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:40.560877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:40.647101 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:40.647694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:40.647972 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:40.648246 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:40.650474 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.742355 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:40.744600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed7e0-d1bf-41bd-a29d-a43851f8f57e service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:40.762257 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 726/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:42.830452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:42.830996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:42.830996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:42.832328 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:42.837775 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebaed0-a4ce-4999-b764-0d2088cff5c0 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:42.838179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebaed0-a4ce-4999-b764-0d2088cff5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:42.838318 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebaed0-a4ce-4999-b764-0d2088cff5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:42.879927 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:43.022149 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-57ebaed0-a4ce-4999-b764-0d2088cff5c0 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:43.023346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-57ebaed0-a4ce-4999-b764-0d2088cff5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.117439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:43.406456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:43.408075 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.512007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c58b-7b33-444d-ae14-8722b02b84d0 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:43.543405 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:43.584677 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:43.585280 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:43.585571 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:43.585840 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:43.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.692064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:43.693439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902a07-6bc2-4cc7-b229-d57c8593128e service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:43.711862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 716/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:45.994460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:45.994909 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:45.995007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:45.996369 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:46.001532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3289-f37a-431e-9ea7-6e44cef80846 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:46.001949 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3289-f37a-431e-9ea7-6e44cef80846 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:46.002084 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3289-f37a-431e-9ea7-6e44cef80846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:46.065957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-8f7d3289-f37a-431e-9ea7-6e44cef80846 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:46.067151 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8f7d3289-f37a-431e-9ea7-6e44cef80846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.079525 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:46.161718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:46.443533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:46.445037 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.546895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57dbe-04a2-490e-af65-f034446dd9f2 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:46.559239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:46.618826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:46.619455 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:46.619731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:46.619996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:46.621581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.728340 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:46.729752 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f72c6-9aa7-4a2f-85e4-f448b801c25e service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:46.747127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 729/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:49.288738 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:49.289342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:49.289342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:49.291352 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:49.296602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521142-2107-4294-9d9b-a44499db9965 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:49.296975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521142-2107-4294-9d9b-a44499db9965 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:49.297152 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521142-2107-4294-9d9b-a44499db9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:49.343930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:49.362599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-1a521142-2107-4294-9d9b-a44499db9965 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:49.363796 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1a521142-2107-4294-9d9b-a44499db9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:49.458287 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:49.746922 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:49.748477 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:49.848334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c5e82-898c-4dcc-b717-25be2e6b71ba None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:49.888428 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:49.921242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:49.921862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:49.922139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:49.922409 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:49.923982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:50.030660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:50.032032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3701c-99c8-40a4-acf7-67c3a85bb31e service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:50.049697 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 719/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:52.294507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:52.295043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:52.295043 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:52.296361 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:52.301573 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac682-3201-42da-b7a7-48fa0c9ac055 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:52.301981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac682-3201-42da-b7a7-48fa0c9ac055 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:52.302175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaac682-3201-42da-b7a7-48fa0c9ac055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:52.366213 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-cbaac682-3201-42da-b7a7-48fa0c9ac055 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:52.367398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-cbaac682-3201-42da-b7a7-48fa0c9ac055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:52.388743 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:52.462952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:52.747975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:52.749574 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:52.850117 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c19732-cb01-44e1-8b99-a7730f8e9800 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:52.870770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:52.923716 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:52.924299 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:52.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:52.924841 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:52.926417 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:53.032566 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:53.033937 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4a2ee-98e7-4f9e-a7e9-56717a27ad11 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:53.052210 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 732/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:55.245392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:55.245961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:55.245961 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:55.247288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:55.252765 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f3e-2978-4215-a452-78f0c94e7c92 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:55.253163 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f3e-2978-4215-a452-78f0c94e7c92 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:55.253368 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10f3e-2978-4215-a452-78f0c94e7c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:55.319651 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:55.322602 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-72d10f3e-2978-4215-a452-78f0c94e7c92 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:55.324387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-72d10f3e-2978-4215-a452-78f0c94e7c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.421002 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:55.703518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:55.705048 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.805857 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8011c6-cf1a-43df-a25e-3228f3617448 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:55.854817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:55.878314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:55.878911 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:55.879456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:55.879727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:55.881354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.988187 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:55.989684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a75f9-84ac-4add-bbb9-7d7b74f5ac5a service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:56.007396 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 722/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:58.188074 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:58.188603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:58.188603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:58.189995 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:58.195281 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292002-292b-4934-a42f-a3c62484fbaa None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:58.195704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292002-292b-4934-a42f-a3c62484fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:58.195830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292002-292b-4934-a42f-a3c62484fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:58.260524 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2c292002-292b-4934-a42f-a3c62484fbaa None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:58.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2c292002-292b-4934-a42f-a3c62484fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:58.289742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:58.355695 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:58.636419 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:58.637966 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:58.738129 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396a0b-dd22-4622-b297-bab9aa83650e None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:58.766168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:58.810481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:58.811069 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:58.811344 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:58.811610 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:58.813158 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:58.921682 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:58.923022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8279-4f4d-4822-91fb-5649ee45afcf service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:58.940767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 735/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:01.183585 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:01.184199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:01.184199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:01.185503 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:01.191131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaf97-9ef7-4daf-b44f-40ea1a0ce574 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:01.191553 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaf97-9ef7-4daf-b44f-40ea1a0ce574 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:01.191673 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaf97-9ef7-4daf-b44f-40ea1a0ce574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:01.261397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-dacbaf97-9ef7-4daf-b44f-40ea1a0ce574 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:01.262622 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-dacbaf97-9ef7-4daf-b44f-40ea1a0ce574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:01.270985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:01.379947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:01.670139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:01.671653 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:01.773924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec91d2-e014-45e1-bab2-26dcb17cfb7d None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:01.829086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:01.847479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:01.848074 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:01.848350 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:01.848618 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:01.850217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:01.963610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:01.964957 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fef1a6-7763-4a54-825e-921c1724be9a service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:01.983313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 725/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:04.215193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:04.215911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:04.215911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:04.217097 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:04.222522 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949aca8-2260-45ed-8ca3-08d4d5303d6e None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:04.223002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949aca8-2260-45ed-8ca3-08d4d5303d6e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:04.223107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949aca8-2260-45ed-8ca3-08d4d5303d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:04.287684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-0949aca8-2260-45ed-8ca3-08d4d5303d6e None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:04.288802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0949aca8-2260-45ed-8ca3-08d4d5303d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:04.342097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:04.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:04.716626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:04.718248 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:04.824458 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8a4f-3532-4989-a66e-7811b47e22b9 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:04.861532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:04.898536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:04.899137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:04.899416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:04.899686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:04.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:05.011126 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:05.012549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9d96-f67b-4f45-9285-85faeeb9c840 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:05.031033 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 738/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:07.217413 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:07.217982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:07.217982 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:07.219357 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:07.224712 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138528e6-784e-4db3-a9ff-1a96c2c5448d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:07.225102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138528e6-784e-4db3-a9ff-1a96c2c5448d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:07.225308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138528e6-784e-4db3-a9ff-1a96c2c5448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:07.290326 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-138528e6-784e-4db3-a9ff-1a96c2c5448d None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:07.292113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-138528e6-784e-4db3-a9ff-1a96c2c5448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:07.309631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:07.388022 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:07.671135 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:07.672686 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:07.774394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ea78-2866-44e0-a073-00966544c980 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:07.839889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:07.846935 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:07.847539 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:07.847817 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:07.848090 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:07.849700 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:07.955834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:07.957192 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb6d2-fda4-4757-8801-82b8abe8afd6 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:07.975488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 728/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:10.179172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31daee4-1a92-4962-927f-82966748d08d None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:10.179739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31daee4-1a92-4962-927f-82966748d08d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:10.179739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31daee4-1a92-4962-927f-82966748d08d None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:10.181064 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:10.186869 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2964c-73c1-4c6a-b07b-b47bed5b2f89 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:10.187268 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2964c-73c1-4c6a-b07b-b47bed5b2f89 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:10.187418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2964c-73c1-4c6a-b07b-b47bed5b2f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:10.251279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-d4a2964c-73c1-4c6a-b07b-b47bed5b2f89 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:10.252398 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d4a2964c-73c1-4c6a-b07b-b47bed5b2f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:10.299325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:10.348003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:10.634293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31daee4-1a92-4962-927f-82966748d08d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:10.635866 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a31daee4-1a92-4962-927f-82966748d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:10.736821 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31daee4-1a92-4962-927f-82966748d08d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:10.784055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:10.810666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:10.811254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:10.811531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:10.811804 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:10.813402 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:10.919985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:10.921359 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847daee-cda3-4f44-9c4a-d409e68bae51 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:10.938588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 741/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:20.346497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=22 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:20.936375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=66 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:31.018551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e67dd-77c0-4a79-9a05-de79f5d58393 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.019003 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e67dd-77c0-4a79-9a05-de79f5d58393 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.019130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e67dd-77c0-4a79-9a05-de79f5d58393 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.020763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 730/1471] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:31.025934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2132-16f8-461b-8bf3-2983a684df71 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.026415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2132-16f8-461b-8bf3-2983a684df71 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.026582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2132-16f8-461b-8bf3-2983a684df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.096658 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-945f2132-16f8-461b-8bf3-2983a684df71 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:31.097900 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-945f2132-16f8-461b-8bf3-2983a684df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.200479 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 742/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:31.520303 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.520791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.521072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.522551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 731/1473] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 30 09:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:31.528654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cf69-c573-4f3c-8915-3c163cda2323 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.528931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cf69-c573-4f3c-8915-3c163cda2323 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.529199 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875cf69-c573-4f3c-8915-3c163cda2323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.603991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f875cf69-c573-4f3c-8915-3c163cda2323 None None] MFA Rules not processed for user `7fa68549998f496ca54350b3bcec0bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:31.605202 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f875cf69-c573-4f3c-8915-3c163cda2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.624809 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:31.680453 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 743/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 30 09:33:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:31.688066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:31.689626 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.789779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480630ab-ade1-4369-82df-f4935ff8e562 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:31.859169 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fa68549998f496ca54350b3bcec0bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:31.859754 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.860030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.860299 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.861907 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.913740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:31.968067 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:31.969483 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a672-334a-46e3-b80a-9e1f9efc3ddf service glance] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:31.987014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 732/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:34.225279 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:34.225843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:34.225843 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:34.227261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 744/1476] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:34.232659 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93d0f-2731-4f4d-a2c4-31564f0ea526 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:34.233101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93d0f-2731-4f4d-a2c4-31564f0ea526 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:34.233224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93d0f-2731-4f4d-a2c4-31564f0ea526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:34.297128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7ac93d0f-2731-4f4d-a2c4-31564f0ea526 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:34.298339 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7ac93d0f-2731-4f4d-a2c4-31564f0ea526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:34.397055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 733/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:34.674760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:34.676211 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:34.800742 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf622a-2e4b-4a84-a907-af6c3cdd0d17 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:34.849447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:34.893506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:34.894109 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:34.894394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:34.894666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:34.895304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:34.897018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:33:34.897018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:33:34.897018 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:33:34.898196 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d3c1-ac85-4c22-8e7a-1845fef489e2 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:34.917330 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 745/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 30 09:33:34 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:33:37.075173 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:37.075747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:37.075747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:37.077046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 734/1479] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:37.082256 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900d7c-bb30-4e9f-b36e-2d0167e40182 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:37.082661 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900d7c-bb30-4e9f-b36e-2d0167e40182 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:37.082817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900d7c-bb30-4e9f-b36e-2d0167e40182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:37.150788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-04900d7c-bb30-4e9f-b36e-2d0167e40182 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:37.151974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-04900d7c-bb30-4e9f-b36e-2d0167e40182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:37.246891 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 746/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:37.540159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:37.541719 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:37.551296 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:37.685450 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb0099-79c7-4164-9d9c-73aebdd843be None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:37.763171 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:37.795331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:37.795929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:37.796205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:37.796474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:37.798077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:37.885765 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:37.887927 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfdc95-980e-46b9-b12c-f0f3216b3041 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:37.904952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 735/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:40.220392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:40.220955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:40.220955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:40.222312 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 747/1482] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:40.227759 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5b06-907d-4627-86f9-e9122f6138c4 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:40.228182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5b06-907d-4627-86f9-e9122f6138c4 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:40.228319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5b06-907d-4627-86f9-e9122f6138c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:40.293633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c5bb5b06-907d-4627-86f9-e9122f6138c4 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:40.294832 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c5bb5b06-907d-4627-86f9-e9122f6138c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.339443 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.389334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 736/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:40.676259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:40.677895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.702269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.780824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e756a6-8b89-4e0e-bd15-c105cc91313c None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:40.852713 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:40.853323 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:40.853604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:40.853871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:40.856019 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.927957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.961552 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:40.962963 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaefc69-1356-4c1f-9811-b9f5945c8a6d service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:40.981744 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 748/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:43.159749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df94-2c59-4278-983d-78067907dea6 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.160342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df94-2c59-4278-983d-78067907dea6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.160342 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072df94-2c59-4278-983d-78067907dea6 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.161660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 737/1485] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:43.166813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddc4-236e-4b12-851b-aa69a1802cd5 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.167262 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddc4-236e-4b12-851b-aa69a1802cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.167393 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddc4-236e-4b12-851b-aa69a1802cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.232370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-1d72ddc4-236e-4b12-851b-aa69a1802cd5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:43.233598 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-1d72ddc4-236e-4b12-851b-aa69a1802cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:43.334017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 749/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:43.634124 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072df94-2c59-4278-983d-78067907dea6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:43.635663 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4072df94-2c59-4278-983d-78067907dea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:43.738673 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072df94-2c59-4278-983d-78067907dea6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:43.808732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:43.810640 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:43.811412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.812013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.812497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.814356 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:43.924453 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:43.925845 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c160a-20a3-4aff-a6c0-7956be0b1392 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:43.943210 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 738/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:46.148869 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.149491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.149491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.150811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 750/1488] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:46.156451 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b44f-8192-428a-a8d4-5976e57c744f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.156868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b44f-8192-428a-a8d4-5976e57c744f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.156988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b44f-8192-428a-a8d4-5976e57c744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.222818 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-98c4b44f-8192-428a-a8d4-5976e57c744f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:46.223994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-98c4b44f-8192-428a-a8d4-5976e57c744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:46.276108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:46.319518 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 739/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:46.610407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:46.611934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:46.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:46.715526 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046678ff-b288-4ee2-b2ec-baf40fbfcffa None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:46.787234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:46.787824 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.788098 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.788365 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.789958 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:46.868506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:46.899058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:46.900486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0abf06-d1a0-49d7-a707-dc00905fc55c service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:46.918120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 751/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:33:49.357847 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.358433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.358433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.359769 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 740/1491] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 30 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:49.365168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1906e-6e71-4d04-9443-060effe68e2c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.365656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1906e-6e71-4d04-9443-060effe68e2c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.365758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1906e-6e71-4d04-9443-060effe68e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.432751 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a1e1906e-6e71-4d04-9443-060effe68e2c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:49.434600 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a1e1906e-6e71-4d04-9443-060effe68e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:49.529071 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 752/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:49.818901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:49.820464 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:49.921955 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170b56-8425-4b69-b0d2-693233e227c6 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:49.994270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:49.994860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.995133 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.995397 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.997026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:50.005223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:50.103932 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:50.105325 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33e82f-1fd0-49f8-9eb8-c2abfbcebdbe service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:50.123200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 741/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:59.527588 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=82 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:00.120954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=50 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:02.241445 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:02.242017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:02.242017 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:02.317549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:02.318656 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:02.414408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 753/1494] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:02.422456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:02.422939 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:02.423054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:02.497200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:02.498915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:02.600710 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 742/1495] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:02.605333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:02.606548 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:02.618030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468fb41-138a-4b9b-9945-16ddd7aef6c5 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:02.679224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:02.712761 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:02.713380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:02.713654 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:02.713921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:02.714581 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:02.714877 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:02.715871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:02.715871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:35:02.715871 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:35:02.716749 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:02.727668 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 754/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:02.736521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:02.745580 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fab60-f8a0-42ab-b089-bdda207bd8e8 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:02.806011 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:02.839312 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:02.839906 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:02.840181 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:02.840448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:02.841076 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:02.842812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:02.842812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:35:02.842812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:35:02.844008 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:02.902418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 743/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:02 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:02.906632 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:02.908261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:02.942447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaecb7-8e0b-454a-ac5f-2d788d4989eb admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:03.039758 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:03.040348 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.040621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.040883 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.041543 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:03.042546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:03.042546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:35:03.042546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:35:03.043753 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:03.086171 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 755/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:02 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:03.090294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:03.092505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.153386 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa8d15-3382-48e2-b7e9-81d3520f7ffd admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:03.236285 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:03.247194 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:03.247787 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.248059 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.248324 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.248956 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:03.249994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:03.249994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:35:03.249994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:35:03.250879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:03.263045 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 744/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:35:03.267080 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:03.268578 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.280379 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e296ae-f9d4-407f-b03d-be0af9830fe7 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:03.305800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:03.378389 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:03.378985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.379258 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.379520 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.380156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:03.381157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:03.381157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:35:03.381157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:35:03.382058 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d6c1-c106-43da-94aa-9d2320602cc5 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:03.394939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 756/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:35:03.399188 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:03.400732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.435242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8906-78ee-4240-80da-d34530970755 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:03.526198 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:03.526841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.527114 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.527385 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] PATH_INFO: `/v3/projects/b2532b01d7cb4de49bf1f506ad73753a/users/8c9e7827e12543e485052115d78f6445/roles/509124be46144611a84fe7272045de87` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.549473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2532b01d7cb4de49bf1f506ad73753a, user_id=8c9e7827e12543e485052115d78f6445, role_id=509124be46144611a84fe7272045de87)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:03.550506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:03.550506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:35:03.550506 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:35:03.552437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f97571-fb34-4f51-bb38-ca6c7ae9a411 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:03.576578 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 745/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:03 2022] PUT /identity/v3/projects/b2532b01d7cb4de49bf1f506ad73753a/users/8c9e7827e12543e485052115d78f6445/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:35:03.588774 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9fc3-27ef-430b-b565-c87c1607cd0b None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.589061 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9fc3-27ef-430b-b565-c87c1607cd0b None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.589368 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a9fc3-27ef-430b-b565-c87c1607cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.646532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c00a9fc3-27ef-430b-b565-c87c1607cd0b None None] MFA Rules not processed for user `8c9e7827e12543e485052115d78f6445`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:03.647750 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c00a9fc3-27ef-430b-b565-c87c1607cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.724444 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 757/1502] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:35:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:03.737455 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.737739 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.738009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.739346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 746/1503] 10.222.0.25 () {54 vars in 963 bytes} [Fri Sep 30 09:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:35:03.744273 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537547-afc0-4ede-b8a6-a97645cadaa3 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:03.744561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537547-afc0-4ede-b8a6-a97645cadaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:03.744835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537547-afc0-4ede-b8a6-a97645cadaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:03.777234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:03.821324 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-99537547-afc0-4ede-b8a6-a97645cadaa3 None None] MFA Rules not processed for user `50516a9eb95f42129b257c5b71b782a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:03.822522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-99537547-afc0-4ede-b8a6-a97645cadaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.897782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 758/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Fri Sep 30 09:35:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:03.905583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:03.907138 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:03.961049 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:04.014298 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c461c-016a-4d6d-a104-e9e404379bd2 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:04.084944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50516a9eb95f42129b257c5b71b782a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:04.085564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:04.085835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:04.086100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:04.087663 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:04.183065 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:04.184496 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:04.188508 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:04.202991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 747/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:04.248181 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2a84-af74-403e-971e-1f690923b18b None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:04.248469 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2a84-af74-403e-971e-1f690923b18b None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:04.248743 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2a84-af74-403e-971e-1f690923b18b None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:04.250016 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 759/1506] 10.222.0.25 () {52 vars in 830 bytes} [Fri Sep 30 09:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:04.253511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:04.254783 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:04.354934 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d582fd9-ee97-4593-bb07-f41001fd4a81 service cinder] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:04.448253 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:04.448881 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:04.449134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:04.449439 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] PATH_INFO: `/v3/users/8c9e7827e12543e485052115d78f6445` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:04.462028 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9e7827e12543e485052115d78f6445)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:04.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:04.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:35:04.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:35:04.464244 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:04.474000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:04.529960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9e7827e12543e485052115d78f6445'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:04.530412 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9e7827e12543e485052115d78f6445'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:04.530936 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9e7827e12543e485052115d78f6445'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:04.539879 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9e7827e12543e485052115d78f6445'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:04.563109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9e7827e12543e485052115d78f6445'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:04.582054 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 748/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:04 2022] DELETE /identity/v3/users/8c9e7827e12543e485052115d78f6445 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:04.586412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:04.586878 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:04.586986 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:04.643492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:04.644638 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:04.724220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:04.737180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 760/1508] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:04.746652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:04.748491 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:04.848241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71df26-77f1-435a-bd17-431abc638bd5 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:04.904197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:04.925515 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:04.926120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:04.926394 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:04.926661 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:04.928220 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:05.032445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:05.033893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdcabf-d536-4d13-b502-7633e1a9a6fe service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:05.051892 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 749/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:05.395917 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:05.397179 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:05.413525 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c70cf-278e-4d4a-b90c-93010f7475d4 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:05.507603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:05.508147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:05.508420 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:05.508705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] PATH_INFO: `/v3/projects/b2532b01d7cb4de49bf1f506ad73753a` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:05.518653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2532b01d7cb4de49bf1f506ad73753a)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:05.519670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:05.519670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:35:05.519670 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:35:05.520860 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:05.578386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2532b01d7cb4de49bf1f506ad73753a', 'request_id': 'req-583e2994-dff1-4b7a-aa17-36701b735bbb'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:05.584943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2532b01d7cb4de49bf1f506ad73753a', 'request_id': 'req-583e2994-dff1-4b7a-aa17-36701b735bbb'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:05.595150 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2532b01d7cb4de49bf1f506ad73753a', 'request_id': 'req-583e2994-dff1-4b7a-aa17-36701b735bbb'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:05.624705 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] The token cache is being invalidate because project b2532b01d7cb4de49bf1f506ad73753a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:05.624996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:05.625550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-583e2994-dff1-4b7a-aa17-36701b735bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:05.626883 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 761/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:05 2022] DELETE /identity/v3/projects/b2532b01d7cb4de49bf1f506ad73753a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:15.049749 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=62 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:15.622729 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:21.090933 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:21.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:21.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:21.092798 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:21.098176 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3c5c-eeee-4b37-b20f-2a0be120a742 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:21.098626 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3c5c-eeee-4b37-b20f-2a0be120a742 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:21.098763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3c5c-eeee-4b37-b20f-2a0be120a742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:21.177721 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-901e3c5c-eeee-4b37-b20f-2a0be120a742 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:21.178921 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-901e3c5c-eeee-4b37-b20f-2a0be120a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:21.281792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:21.435632 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:21.437780 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:21.553425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5bf83-d63f-4321-9d3e-934d1987e761 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:21.558842 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:21.559434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:21.559709 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:21.559977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:21.568617 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:21.570226 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c6645-0cd3-43e1-8fea-30e8e260f268 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:21.579938 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 751/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:22.660483 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b70-fd23-4c5a-b503-79022e217cf7 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:22.661014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b70-fd23-4c5a-b503-79022e217cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:22.661014 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b70-fd23-4c5a-b503-79022e217cf7 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:22.662351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:22.668761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c96-cee7-41a2-80d1-15bcb634c5c9 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:22.669190 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c96-cee7-41a2-80d1-15bcb634c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:22.669346 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c96-cee7-41a2-80d1-15bcb634c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:22.689487 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-53529c96-cee7-41a2-80d1-15bcb634c5c9 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:22.690680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-53529c96-cee7-41a2-80d1-15bcb634c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:22.698474 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:22.851681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8b70-fd23-4c5a-b503-79022e217cf7 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:22.866351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8b70-fd23-4c5a-b503-79022e217cf7 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:22.871697 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:22.872276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:22.872554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:22.872828 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:22.881351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:22.882925 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d58821-ddfc-47d6-93db-5bcdcdbdce46 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:22.892286 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 764/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:25.635568 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f916c-f652-445c-8114-0e6859431850 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:25.636184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f916c-f652-445c-8114-0e6859431850 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:25.636184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f916c-f652-445c-8114-0e6859431850 None None] PATH_INFO: `/v3` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:25.637461 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 753/1517] 10.222.0.30 () {54 vars in 925 bytes} [Fri Sep 30 09:36:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:25.644381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950419-b482-469a-a9d6-6029ff4bc8ea None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:25.644835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950419-b482-469a-a9d6-6029ff4bc8ea None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:25.644943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950419-b482-469a-a9d6-6029ff4bc8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:25.706412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-25950419-b482-469a-a9d6-6029ff4bc8ea None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:25.707621 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-25950419-b482-469a-a9d6-6029ff4bc8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:25.724980 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:25.779599 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 765/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 30 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:29.292600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e1d3-c6fd-448c-aa47-1c86a80e6592 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e1d3-c6fd-448c-aa47-1c86a80e6592 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.293166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e1d3-c6fd-448c-aa47-1c86a80e6592 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.294628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 754/1519] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:29.299935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f6fc-934a-4ad3-988b-10111e3d3a86 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.300345 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f6fc-934a-4ad3-988b-10111e3d3a86 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.300486 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f6fc-934a-4ad3-988b-10111e3d3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.320250 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-6727f6fc-934a-4ad3-988b-10111e3d3a86 None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:29.321491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6727f6fc-934a-4ad3-988b-10111e3d3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.334491 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 766/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:29.342371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792e1d3-c6fd-448c-aa47-1c86a80e6592 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.358119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792e1d3-c6fd-448c-aa47-1c86a80e6592 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.363574 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.364185 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.364514 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.364814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.373373 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.375683 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ace0-9459-4c83-b745-8d1b0a5c5b15 service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.385134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 755/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:34.363472 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6007-09b1-468e-b7e9-6282a3d2adbb None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.363952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6007-09b1-468e-b7e9-6282a3d2adbb None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.363952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6007-09b1-468e-b7e9-6282a3d2adbb None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.365346 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:34.371898 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805fa1-3bbf-43f1-bf95-f3d848dbf398 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.372331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805fa1-3bbf-43f1-bf95-f3d848dbf398 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.372476 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805fa1-3bbf-43f1-bf95-f3d848dbf398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.392081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-72805fa1-3bbf-43f1-bf95-f3d848dbf398 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:34.393278 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-72805fa1-3bbf-43f1-bf95-f3d848dbf398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:34.407429 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:34.566560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6007-09b1-468e-b7e9-6282a3d2adbb None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.580911 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6007-09b1-468e-b7e9-6282a3d2adbb None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.586193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.586772 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.587049 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.587315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.595224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.596799 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b7512-90f0-43d0-ba8d-8d72e5e5f69b service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.605881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 768/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:35.707000 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a8f5-893d-49f6-bf1a-e624f15b0120 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.707531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a8f5-893d-49f6-bf1a-e624f15b0120 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.707531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a8f5-893d-49f6-bf1a-e624f15b0120 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.709046 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:35.715217 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfb4c-a55f-448a-8674-1053dae03053 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.715706 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfb4c-a55f-448a-8674-1053dae03053 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.715823 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdfb4c-a55f-448a-8674-1053dae03053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.736010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-63bdfb4c-a55f-448a-8674-1053dae03053 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:35.737319 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-63bdfb4c-a55f-448a-8674-1053dae03053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.745259 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:35.904172 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0a8f5-893d-49f6-bf1a-e624f15b0120 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.918290 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0a8f5-893d-49f6-bf1a-e624f15b0120 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.923951 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.924538 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.924814 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.925086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.933030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.934649 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0919a6b-9c1a-40cd-ac88-c1516a3bd6a3 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.944206 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 758/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:39.891459 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:39.892005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:39.892005 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:39.893374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:39.898543 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600534e9-cbdd-4ed5-8c42-9f3d7a628410 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:39.898986 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600534e9-cbdd-4ed5-8c42-9f3d7a628410 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:39.899081 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600534e9-cbdd-4ed5-8c42-9f3d7a628410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:39.917848 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-600534e9-cbdd-4ed5-8c42-9f3d7a628410 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:39.919015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-600534e9-cbdd-4ed5-8c42-9f3d7a628410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:39.927106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:40.214807 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:40.216493 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:40.294648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0bb27-5db3-496a-939e-bd02003ce135 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:40.298168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:40.298769 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:40.299044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:40.299315 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:40.308025 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:40.309499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6451fa-f3e0-4a07-b5b9-5abfede78504 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:40.319112 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 771/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:42.453598 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:42.454140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:42.454140 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:42.455475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:42.460629 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3530d-1663-44ed-8474-542bb8380cca None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:42.461076 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3530d-1663-44ed-8474-542bb8380cca None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:42.461241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3530d-1663-44ed-8474-542bb8380cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:42.480830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-c2e3530d-1663-44ed-8474-542bb8380cca None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:42.482055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-c2e3530d-1663-44ed-8474-542bb8380cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:42.489926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:42.781291 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:42.783091 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:42.795807 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277d831-ef9a-4693-ac21-a6ff75e56a5e None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:42.799334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:42.799915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:42.800189 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:42.800459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:42.809131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:42.810602 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579ae9d-1e7b-45fb-a0c1-a9185c2052bf service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:42.819761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 761/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:46.403991 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.404501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.404501 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.405941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:46.411375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70115f-f277-4fd7-95cc-a3564aa1e4bd None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.411862 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70115f-f277-4fd7-95cc-a3564aa1e4bd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.411968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70115f-f277-4fd7-95cc-a3564aa1e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.419642 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=81 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:46.432270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-ee70115f-f277-4fd7-95cc-a3564aa1e4bd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:46.433583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ee70115f-f277-4fd7-95cc-a3564aa1e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:46.442099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:46.748492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:46.750747 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:46.814424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:46.827974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0c1a-9976-48ef-8b79-eb62064055b9 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:46.831557 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50516a9eb95f42129b257c5b71b782a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:46.832173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.832546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.832819 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.841714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:46.843138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70227-615c-48f3-9780-dfdae1336fc6 service cinder] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:46.852364 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 774/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:49.080815 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802892e8-2773-499f-a024-6879666d27ff None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.081519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802892e8-2773-499f-a024-6879666d27ff None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.081519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802892e8-2773-499f-a024-6879666d27ff None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.082819 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:49.088023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef75f-504d-4a44-833c-d962bf02ca85 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.088550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef75f-504d-4a44-833c-d962bf02ca85 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.088550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef75f-504d-4a44-833c-d962bf02ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.108235 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-bd6ef75f-504d-4a44-833c-d962bf02ca85 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:49.109957 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-bd6ef75f-504d-4a44-833c-d962bf02ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.117617 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:49.424830 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802892e8-2773-499f-a024-6879666d27ff None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.426552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-802892e8-2773-499f-a024-6879666d27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.439910 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802892e8-2773-499f-a024-6879666d27ff None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.443402 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50516a9eb95f42129b257c5b71b782a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.443984 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.444263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.444532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.454036 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.456403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9faba-0c85-4d5c-91a9-393228afb263 service cinder] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.470895 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 764/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:59.102862 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=11 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:59.464456 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=8 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:04.931465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290933e-d482-4257-9198-33d7e50d536c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.932070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290933e-d482-4257-9198-33d7e50d536c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.932070 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290933e-d482-4257-9198-33d7e50d536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.947242 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428953-338c-44cd-8b53-c0261c8994dd None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.947786 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428953-338c-44cd-8b53-c0261c8994dd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.947904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428953-338c-44cd-8b53-c0261c8994dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.955777 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d290933e-d482-4257-9198-33d7e50d536c None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:04.956975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d290933e-d482-4257-9198-33d7e50d536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:04.964858 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 776/1540] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:04.967432 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-f9428953-338c-44cd-8b53-c0261c8994dd None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:04.968588 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-f9428953-338c-44cd-8b53-c0261c8994dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:04.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.973115 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.973416 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.976309 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 765/1541] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:04.984086 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.984368 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.984638 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.992182 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:04.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:05.001619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 777/1542] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:05.004241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:05.005473 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:05.006239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.013332 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 766/1543] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:05.015612 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f909e6-f481-43aa-8181-756f13816a0f None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.018633 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.020447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.021030 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.021327 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.021595 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] PATH_INFO: `/v3/domains` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.022245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:05.022522 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.024099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.027808 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea31f3-f1e2-4c90-b5c9-e79f2ebbb5cf None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.032410 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.033017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.033331 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.033607 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] PATH_INFO: `/v3/domains` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.034247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:05.034551 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.035552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:38:05.035552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:38:05.035552 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:38:05.035817 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 778/1544] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:38:05.036434 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.043731 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.048671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 767/1545] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:38:05.053042 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d81eb-de5a-4391-9c9c-f31a7a10dffb admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.056254 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.057805 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.058386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.058660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.058930 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.059547 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.061072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:38:05.061072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:38:05.061072 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:38:05.062292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.066761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140dd6b-c32f-4b87-aac7-cced590bc64b admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.072289 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.072898 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.073199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.073943 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.074590 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.076520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.099850 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 779/1546] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:05.103881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.109153 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 768/1547] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:05.113355 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.174908 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed731d1-ecd8-4f35-986e-8be6b3f9d48b admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.176121 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a69-6df8-4b38-846e-f105e6f5995c admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.179499 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.180095 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.180642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.181079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.181276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.181702 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.181981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.182267 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.182870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.183230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.183860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: WARNING py.warnings [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:38:05.183860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: warnings.warn(msg) Sep 30 09:38:05.183860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: Sep 30 09:38:05.185062 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.208113 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 780/1548] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:05.208333 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 769/1549] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:05.209189 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.211619 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.220193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df446e6-8aca-438d-8011-4a9680e89ac9 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.222009 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741cfda-9bc0-4aca-849b-2dd7614a4320 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.224818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.225436 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.225714 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.225985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.226628 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.226812 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.227400 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.227711 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.227985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.228347 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.228616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.230240 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.239660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 781/1550] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:05.241286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 770/1551] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:05.243465 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.253044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7f78-b159-431c-87ba-2771993c9ace admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.254094 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4dec7-cdaf-42b6-91e1-62682a1a6384 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.257681 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.258254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.258530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.258671 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.258794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.259234 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.259418 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.259521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.259762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.260408 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.260983 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.262170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.272392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 782/1552] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:05.276354 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 771/1553] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:05.276507 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.277217 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.286730 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049504-8d67-45b3-9ace-16f67ec22651 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.287055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4696ff-0701-4479-926d-30bf111bfcca admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.291480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.291902 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.292078 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.292355 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.292523 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.292614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] PATH_INFO: `/v3/projects/df96960447ef47b19f4bebcb732d93ea/users/f0a9500fab2f4fbdb2d47604ed164fd1/roles/509124be46144611a84fe7272045de87` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.292822 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.293129 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] PATH_INFO: `/v3/projects/db2023a4ff9446469b4e14aaffe850a0/users/ba6be524dfc54ac2a972f6e3ba2e601b/roles/509124be46144611a84fe7272045de87` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.306946 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df96960447ef47b19f4bebcb732d93ea, user_id=f0a9500fab2f4fbdb2d47604ed164fd1, role_id=509124be46144611a84fe7272045de87)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.307952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: WARNING py.warnings [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:38:05.307952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: warnings.warn(msg) Sep 30 09:38:05.307952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: Sep 30 09:38:05.308264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2023a4ff9446469b4e14aaffe850a0, user_id=ba6be524dfc54ac2a972f6e3ba2e601b, role_id=509124be46144611a84fe7272045de87)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.309914 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1456e7f-56ad-4677-8dc6-d476f54394e8 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.310920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f51f-d808-456a-bc84-d975a8032ab9 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.322820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 783/1554] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:05 2022] PUT /identity/v3/projects/df96960447ef47b19f4bebcb732d93ea/users/f0a9500fab2f4fbdb2d47604ed164fd1/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:05.327228 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 772/1555] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:05 2022] PUT /identity/v3/projects/db2023a4ff9446469b4e14aaffe850a0/users/ba6be524dfc54ac2a972f6e3ba2e601b/roles/509124be46144611a84fe7272045de87 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:05.328554 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.328915 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.329289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.329828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.330388 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.348274 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:05.348652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] MFA Rules not processed for user `747baf23ba054f8aad78324c55ee7740`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:05.349497 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:05.349831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:05.391394 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:05.399199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:05.411611 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 784/1556] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:05.415057 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 773/1557] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:05.421996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.422175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:05.476116 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64709fe-1912-4946-9e3a-155abc31d39a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.476304 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea8c0-8b89-4e0c-a042-8388eed26576 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:05.479589 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.479876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:05.480184 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.480458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.480562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:05.480721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.480816 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:05.480994 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:05.489834 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.490010 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:05.491263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae0e0-ee3c-4a4e-86c7-1ae414e31a55 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.491412 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ac1a-599c-476b-acc1-c27a45c7cd5f service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:05.500684 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 774/1558] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:38:05.501122 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 785/1559] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:10.594470 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.595063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.595063 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.624767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a94-385e-4282-9699-0e876bc01430 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.625220 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a94-385e-4282-9699-0e876bc01430 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.625351 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de442a94-385e-4282-9699-0e876bc01430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.663057 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] MFA Rules not processed for user `f0a9500fab2f4fbdb2d47604ed164fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:10.664271 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:10.672922 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-de442a94-385e-4282-9699-0e876bc01430 None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:10.674948 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-de442a94-385e-4282-9699-0e876bc01430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:10.762105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 786/1560] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:10.767618 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de442a94-385e-4282-9699-0e876bc01430 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.781350 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de442a94-385e-4282-9699-0e876bc01430 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:10.789735 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:10.790380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.790663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.790939 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.793473 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:10.796322 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:10.804929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 775/1561] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:10.811005 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.830635 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca6b4b-439f-449d-bd24-c21de971ee46 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:10.835548 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:10.836234 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.836616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.837014 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.837793 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:10.839825 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:10.858934 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 787/1562] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:10.862955 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.885475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 776/1563] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:10.890286 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.968462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:10.974480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f30cd-40fe-4162-a7fc-2472081f1602 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.000726 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af981-9c9e-4a55-a4b7-0cd82bd47f4a admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.006440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.007294 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.007992 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.008411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] PATH_INFO: `/v3/users` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.009399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.012262 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.025123 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:11.038730 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 777/1564] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:11.042872 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.046417 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.048425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.049212 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.051114 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] PATH_INFO: `/v3/users` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.052422 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.054425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545a04-fc28-48c8-bcaa-9fe4f8122560 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.055575 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.059158 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.059758 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.060835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.061682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.063275 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.074567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 778/1565] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:11.079445 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.088206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 788/1566] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:11.090041 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e3d3-3fc4-4b5f-b183-9cbbe70ee064 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.091906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.095019 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.095692 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.095980 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.096322 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] PATH_INFO: `/v3/projects/b4aea277e33b42ffacad40e33ff38aca/users/2a0a5b227d424b34b67136e45e26a832/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.113408 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24dc93-79de-4617-85e9-5015cea680ee admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.116150 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aea277e33b42ffacad40e33ff38aca, user_id=2a0a5b227d424b34b67136e45e26a832, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.118533 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.119127 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.119237 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.119535 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.119813 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.120454 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.122300 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.134265 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 789/1567] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.138123 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.141223 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 779/1568] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/b4aea277e33b42ffacad40e33ff38aca/users/2a0a5b227d424b34b67136e45e26a832/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:11.144794 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.150530 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be4a-bb16-4716-8a11-909cb5ed5115 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.217531 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a96e2-37b6-49cb-85fc-daf3ced2f2cf admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.219162 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.220239 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.220560 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.220949 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] PATH_INFO: `/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9/users/90a39a98848d4158986a28c33a7ed129/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.226802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.226802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.226802 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.227270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] PATH_INFO: `/v3/roles` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.228390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.230565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.240012 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=524e04e4f28b45fe9acf4b28a48d3ff9, user_id=90a39a98848d4158986a28c33a7ed129, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.242984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.246856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 780/1569] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.251851 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.271633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 790/1570] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9/users/90a39a98848d4158986a28c33a7ed129/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:11.275655 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.278616 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267b6a-7eb5-4ab8-88e6-abf175fe412a admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.345909 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.346785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.347403 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.347540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] PATH_INFO: `/v3/projects/b4aea277e33b42ffacad40e33ff38aca/users/2a0a5b227d424b34b67136e45e26a832/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.349493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aea277e33b42ffacad40e33ff38aca, user_id=2a0a5b227d424b34b67136e45e26a832, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.359425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.360407 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004515ff-b238-4b30-a838-3a608fedec9a admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.365354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.365964 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.366241 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.366509 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.367161 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.369026 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64225d-d768-4975-8f70-f0713d7e08e3 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.377747 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 781/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/b4aea277e33b42ffacad40e33ff38aca/users/2a0a5b227d424b34b67136e45e26a832/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:11.385193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 791/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.392512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.475097 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:11.500766 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96984e07-8fb4-4350-8b10-a1bf0d7f0659 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.506650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.507321 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.507603 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.507873 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] PATH_INFO: `/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9/users/90a39a98848d4158986a28c33a7ed129/roles/fae19a3dd1304ccdaeae8710b6e07ce0` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.509901 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524e04e4f28b45fe9acf4b28a48d3ff9, user_id=90a39a98848d4158986a28c33a7ed129, role_id=fae19a3dd1304ccdaeae8710b6e07ce0)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.512599 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.529211 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 782/1573] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9/users/90a39a98848d4158986a28c33a7ed129/roles/fae19a3dd1304ccdaeae8710b6e07ce0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:17.875506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326454c1-50a7-4b65-b558-342c5f4dda8c None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:17.875506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326454c1-50a7-4b65-b558-342c5f4dda8c None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:17.875506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326454c1-50a7-4b65-b558-342c5f4dda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:17.884769 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:17.935652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-326454c1-50a7-4b65-b558-342c5f4dda8c None None] MFA Rules not processed for user `2a0a5b227d424b34b67136e45e26a832`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:17.937175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-326454c1-50a7-4b65-b558-342c5f4dda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.070283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 792/1574] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:18.083341 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.085475 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.209218 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e475-7bf8-4403-a52f-7d3ff966cda3 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.215512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fa68549998f496ca54350b3bcec0bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.222803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.223395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.224050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.275977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e120-e0df-4a1b-beba-9345ce98cdac None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.276262 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e120-e0df-4a1b-beba-9345ce98cdac None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.276536 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e120-e0df-4a1b-beba-9345ce98cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.294029 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.295656 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.305708 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 783/1575] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:18.312820 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-3754e120-e0df-4a1b-beba-9345ce98cdac None None] MFA Rules not processed for user `90a39a98848d4158986a28c33a7ed129`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:18.314375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-3754e120-e0df-4a1b-beba-9345ce98cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.430285 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 793/1576] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:18.439567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.442026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.478732 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a98f7-3c69-4b35-8080-4bb682fdeca0 service glance] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.484773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fa68549998f496ca54350b3bcec0bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.485437 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.485713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.485987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.535806 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185d15-d7aa-4d15-94a5-4733fa6ffe7d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.536740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185d15-d7aa-4d15-94a5-4733fa6ffe7d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.537187 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185d15-d7aa-4d15-94a5-4733fa6ffe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.574310 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.577283 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.591301 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 784/1577] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:38:18.605160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-e3185d15-d7aa-4d15-94a5-4733fa6ffe7d None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:18.606537 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-e3185d15-d7aa-4d15-94a5-4733fa6ffe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.668460 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=100 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:18.697206 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 794/1578] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:18.855340 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.857241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.884996 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:18.984629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfed26-79a2-4ed5-bb42-c6fe2ceec1b4 service glance] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.991441 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.992166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.992650 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.992991 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:19.003235 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:19.005055 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:19.016931 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 785/1579] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:38:20.119216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c94cd-8581-4b96-86d2-fc085c251c13 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:20.119746 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c94cd-8581-4b96-86d2-fc085c251c13 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:20.119992 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c94cd-8581-4b96-86d2-fc085c251c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:20.163164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-162c94cd-8581-4b96-86d2-fc085c251c13 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:20.165439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-162c94cd-8581-4b96-86d2-fc085c251c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:20.184023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 795/1580] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:20.198913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:20.233687 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095b4c-4271-4fa6-bb3d-c2b67800481e service swift] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:20.274760 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:20.275655 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:20.276256 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:20.276676 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:20.305823 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:20.308431 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecedea5-7904-4136-9c33-a49bdf0d8858 service swift] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:20.318727 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 786/1581] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:38:29.519120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb4ff-c0d7-4f51-ae81-c7ef52cdc62d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.519695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb4ff-c0d7-4f51-ae81-c7ef52cdc62d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.519849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb4ff-c0d7-4f51-ae81-c7ef52cdc62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.539663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-f30eb4ff-c0d7-4f51-ae81-c7ef52cdc62d None None] MFA Rules not processed for user `f0a9500fab2f4fbdb2d47604ed164fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:29.540880 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-f30eb4ff-c0d7-4f51-ae81-c7ef52cdc62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.549192 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 796/1582] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:29.854034 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b67df-59f4-4353-a530-1e85cb381b86 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.854697 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b67df-59f4-4353-a530-1e85cb381b86 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.854973 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b67df-59f4-4353-a530-1e85cb381b86 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.856557 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 787/1583] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:29.862751 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ed5f-2388-464f-be79-e8c62a969123 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.863044 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ed5f-2388-464f-be79-e8c62a969123 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.863403 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5ed5f-2388-464f-be79-e8c62a969123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.906575 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-def5ed5f-2388-464f-be79-e8c62a969123 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:29.907800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-def5ed5f-2388-464f-be79-e8c62a969123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.978876 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 797/1584] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:29.984971 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772580ed-b341-4a18-b9f9-b945cd6059fa None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.985279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772580ed-b341-4a18-b9f9-b945cd6059fa None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.985565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772580ed-b341-4a18-b9f9-b945cd6059fa None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.986967 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 788/1585] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 30 09:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:29.992277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f6df-387d-4119-915c-98bbb701128b None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.992564 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f6df-387d-4119-915c-98bbb701128b None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.992840 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f6df-387d-4119-915c-98bbb701128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.012688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b399f6df-387d-4119-915c-98bbb701128b None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:30.014506 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b399f6df-387d-4119-915c-98bbb701128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.023965 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 798/1586] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:30.036774 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772580ed-b341-4a18-b9f9-b945cd6059fa None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.047359 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772580ed-b341-4a18-b9f9-b945cd6059fa None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.050913 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fa68549998f496ca54350b3bcec0bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.051497 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.051768 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.052030 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.062349 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.063742 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b6e68-22a3-423d-b290-11fd5dd2df86 service glance] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.074279 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 789/1587] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:30.525276 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916091-7bd7-4550-ade9-b1fcf17874c6 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.525794 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916091-7bd7-4550-ade9-b1fcf17874c6 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.525887 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916091-7bd7-4550-ade9-b1fcf17874c6 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.527238 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 799/1588] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 30 09:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:30.532915 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f63d-d064-4fcc-97b0-e644551927dd None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.533199 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f63d-d064-4fcc-97b0-e644551927dd None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.533502 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f63d-d064-4fcc-97b0-e644551927dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.570804 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4902f63d-d064-4fcc-97b0-e644551927dd None None] MFA Rules not processed for user `6d02936fe7de42d7a441bdb0e0d60fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:30.571995 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4902f63d-d064-4fcc-97b0-e644551927dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.623540 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 790/1589] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:30.635298 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916091-7bd7-4550-ade9-b1fcf17874c6 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.646056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916091-7bd7-4550-ade9-b1fcf17874c6 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.649553 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.650132 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.650409 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.650678 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.658003 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.659423 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1309ae-9140-4bc2-b28c-58618fef0de7 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.666977 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 800/1590] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:31.053101 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b91f1-2656-4227-a123-d243db818c42 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.053577 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b91f1-2656-4227-a123-d243db818c42 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.053875 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b91f1-2656-4227-a123-d243db818c42 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.061241 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 791/1591] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:38:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:31.086985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efb90-eb47-46a3-9fc5-56b4c7f11fb7 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.086985 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efb90-eb47-46a3-9fc5-56b4c7f11fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.087232 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efb90-eb47-46a3-9fc5-56b4c7f11fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.107675 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b91f1-2656-4227-a123-d243db818c42 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.126357 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-ee5efb90-eb47-46a3-9fc5-56b4c7f11fb7 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:31.127792 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-ee5efb90-eb47-46a3-9fc5-56b4c7f11fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.151305 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 801/1592] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:31.157480 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd64c-46bb-490f-b1de-06ba13f70fe3 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.157788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd64c-46bb-490f-b1de-06ba13f70fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.158039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dd64c-46bb-490f-b1de-06ba13f70fe3 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.163947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 802/1593] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 30 09:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:31.165225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.165521 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.165800 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.187290 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:31.188704 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.194985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=100 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:31.199284 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 803/1594] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:31.211370 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b91f1-2656-4227-a123-d243db818c42 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.211768 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.216629 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.217307 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.217592 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.217868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.219613 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.221386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba7425-c1c0-4875-a070-33ab0fcd553d None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.224938 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.225562 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.225835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.226103 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.231660 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.233319 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12dc5-0012-4461-a068-72e1eaf22ee5 service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.240325 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.242420 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.245427 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 792/1595] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:31.256532 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 804/1596] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:38:32.943945 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3c7b2-ae56-4162-a0ec-c97793c97d28 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:32.944418 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3c7b2-ae56-4162-a0ec-c97793c97d28 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:32.944501 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3c7b2-ae56-4162-a0ec-c97793c97d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:32.974336 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-59c3c7b2-ae56-4162-a0ec-c97793c97d28 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:32.975628 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-59c3c7b2-ae56-4162-a0ec-c97793c97d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:32.983207 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 793/1597] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:32.995945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:33.008084 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea6b2-37c6-48c8-80b6-d4e4ef61ae1c service neutron] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:33.013836 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:33.019489 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:33.020281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:33.020281 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:33.029762 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:33.031468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:33.043952 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 805/1598] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:38:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:38:33.726446 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd9aa-725f-48ea-b94e-53a7923856ca None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:33.726751 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd9aa-725f-48ea-b94e-53a7923856ca None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:33.727107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bd9aa-725f-48ea-b94e-53a7923856ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:33.780106 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c01bd9aa-725f-48ea-b94e-53a7923856ca None None] MFA Rules not processed for user `6d02936fe7de42d7a441bdb0e0d60fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:33.781511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c01bd9aa-725f-48ea-b94e-53a7923856ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:33.809232 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 794/1599] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 30 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:41.227283 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:41.236874 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5f86-1875-48fa-9e82-75970d48856f service swift] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:41.240674 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:41.241417 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:41.241784 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:41.242057 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:41.249425 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:41.251009 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8778f-e29e-46a6-8ad5-d3fbea900220 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:41.259216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 806/1600] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:42.048828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3fa6-0054-4bed-9791-3b1f2cc971fb None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:42.049449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3fa6-0054-4bed-9791-3b1f2cc971fb None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:42.049449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3fa6-0054-4bed-9791-3b1f2cc971fb None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:42.050904 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 795/1601] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:42.075119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc24-9f56-4da4-871c-73b8422990b8 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:42.075950 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc24-9f56-4da4-871c-73b8422990b8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:42.076172 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc24-9f56-4da4-871c-73b8422990b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:42.096291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-2ba9dc24-9f56-4da4-871c-73b8422990b8 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:42.097550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-2ba9dc24-9f56-4da4-871c-73b8422990b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:42.106534 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 807/1602] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:42.137512 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3fa6-0054-4bed-9791-3b1f2cc971fb None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:42.153179 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3fa6-0054-4bed-9791-3b1f2cc971fb None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:42.158647 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:42.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:42.159519 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:42.159791 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:42.170440 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:42.173395 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5c77-f4e6-4ed3-b8a1-568fc2dc4f3f service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:42.183425 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 796/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:48.073568 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7dde-8e46-454f-b1dc-25cdd8cc42a8 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:48.074153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7dde-8e46-454f-b1dc-25cdd8cc42a8 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:48.074153 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed7dde-8e46-454f-b1dc-25cdd8cc42a8 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:48.075484 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 808/1604] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:38:48.083785 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:48.084237 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:48.084441 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:48.105452 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:48.107088 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:48.117031 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 797/1605] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:48.134247 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7dde-8e46-454f-b1dc-25cdd8cc42a8 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:48.149137 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed7dde-8e46-454f-b1dc-25cdd8cc42a8 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:48.154224 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:48.154811 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:48.155085 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:48.155355 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:48.165292 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:48.166943 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec265f2-c1e1-47c0-ab76-cb9bd2ea8230 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:48.179307 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 809/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:58.100831 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=21 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:58.173993 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=92 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:06.876109 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:06.886164 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e05b-636f-49eb-b604-4329fdf76458 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:06.890821 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:06.891801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:06.892224 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:06.892542 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:06.902182 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:06.904202 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91312-d459-44ee-b1f8-cde3027bbcf8 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:06.913300 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 798/1607] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:12.078406 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f535-c89f-49cb-9224-915dcf2d46ad None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:12.078901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f535-c89f-49cb-9224-915dcf2d46ad None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:12.079000 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f535-c89f-49cb-9224-915dcf2d46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:12.097398 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-b815f535-c89f-49cb-9224-915dcf2d46ad None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:12.098580 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b815f535-c89f-49cb-9224-915dcf2d46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:12.105316 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 810/1608] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:16.909264 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=6 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:22.092492 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:50.275313 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:50.275835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:50.275835 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:50.294130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:50.295848 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:50.302988 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 799/1609] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:50.588442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd046fc-9912-44ca-8fd6-680fb2e403dd None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:50.588941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd046fc-9912-44ca-8fd6-680fb2e403dd None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:50.589035 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd046fc-9912-44ca-8fd6-680fb2e403dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:50.609099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-9bd046fc-9912-44ca-8fd6-680fb2e403dd None None] MFA Rules not processed for user `6d02936fe7de42d7a441bdb0e0d60fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:50.610334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-9bd046fc-9912-44ca-8fd6-680fb2e403dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:50.616653 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 811/1610] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:50.628007 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:50.637682 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4d06b-5bab-4108-b76f-1e4f6696f64c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:50.641149 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:50.642066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:50.642401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:50.642680 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:50.649520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:50.650953 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:50.659050 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 800/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:00.603278 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:00.655725 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=9 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:06.178124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978d3f-c31e-40b0-bbe9-6e9a45a863ee None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:06.178604 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978d3f-c31e-40b0-bbe9-6e9a45a863ee None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:06.178688 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978d3f-c31e-40b0-bbe9-6e9a45a863ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:06.197686 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-29978d3f-c31e-40b0-bbe9-6e9a45a863ee None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:06.198882 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-29978d3f-c31e-40b0-bbe9-6e9a45a863ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:06.206510 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 812/1612] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:06.246838 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:06.259828 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cdc6f-7b37-4989-9b8c-0aebd377e402 service neutron] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:06.264776 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:06.265981 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:06.266258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:06.266528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:06.275100 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:06.276713 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcc268-8953-4c56-9dab-2db88b82cd6c service swift] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:06.284704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 801/1613] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:40:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:40:09.609356 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:09.609814 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:09.609926 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:09.628442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:09.629675 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:09.636441 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 813/1614] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:40:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:16.281441 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=6 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:19.623200 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=6 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:35.679924 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be113c2-2c22-4c84-b986-062ae5170176 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:35.680436 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be113c2-2c22-4c84-b986-062ae5170176 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:35.680586 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be113c2-2c22-4c84-b986-062ae5170176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:35.701555 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2be113c2-2c22-4c84-b986-062ae5170176 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:35.702770 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2be113c2-2c22-4c84-b986-062ae5170176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:35.710520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 802/1615] 10.222.0.25 () {58 vars in 967 bytes} [Fri Sep 30 09:40:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:35.723468 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:35.734859 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fc9ff-46a6-4d29-80cb-a92687d64825 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:35.740023 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:35.740709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:35.741052 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:35.741428 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:35.749180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:35.750778 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:35.759011 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 814/1616] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:40:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:40:45.696017 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:45.755884 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=6 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:51.220813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8a5a-637d-4fff-80af-fb8b2809299c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.221330 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8a5a-637d-4fff-80af-fb8b2809299c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.221421 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8a5a-637d-4fff-80af-fb8b2809299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.239954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-6cfe8a5a-637d-4fff-80af-fb8b2809299c None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:51.241134 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-6cfe8a5a-637d-4fff-80af-fb8b2809299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.247853 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 803/1617] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:01.235175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=3 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:06.597771 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:06.606585 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5d83a-db4b-4838-badc-ddc3d435948a service swift] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:06.610056 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:06.610633 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:06.610906 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:06.611175 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:06.619725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:06.621130 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880bc68-33ba-4b42-bc9d-fc3580125b52 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:06.630386 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 815/1618] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:16.626184 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=6 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:29.835652 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98dc36-96fe-4293-9614-4f6cea4d63d1 None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.836103 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98dc36-96fe-4293-9614-4f6cea4d63d1 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.836200 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98dc36-96fe-4293-9614-4f6cea4d63d1 None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.837545 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 804/1619] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 30 09:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:41:29.842699 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745337e-7bc6-446f-b3fc-fa21de277c52 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.843092 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745337e-7bc6-446f-b3fc-fa21de277c52 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.843277 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745337e-7bc6-446f-b3fc-fa21de277c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.864124 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-d745337e-7bc6-446f-b3fc-fa21de277c52 None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:29.865353 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-d745337e-7bc6-446f-b3fc-fa21de277c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:29.873745 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 816/1620] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 30 09:41:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:29.881095 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98dc36-96fe-4293-9614-4f6cea4d63d1 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:29.894270 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98dc36-96fe-4293-9614-4f6cea4d63d1 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:29.899583 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:29.900162 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.900435 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.900704 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.908520 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:29.910120 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6152f48-de54-4418-8814-6b9c424b7a5d service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:29.919868 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 805/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:39.859096 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:39.915997 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=6 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:14.740760 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14630-95b8-449c-a99d-a509e36e2212 None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:14.741191 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14630-95b8-449c-a99d-a509e36e2212 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:14.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14630-95b8-449c-a99d-a509e36e2212 None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:14.742924 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 817/1622] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:14.748488 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d60f6-8c2e-40c4-a2a6-1900fca23a6b None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:14.749449 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d60f6-8c2e-40c4-a2a6-1900fca23a6b None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:14.749870 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d60f6-8c2e-40c4-a2a6-1900fca23a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:14.775528 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-544d60f6-8c2e-40c4-a2a6-1900fca23a6b None None] MFA Rules not processed for user `1ae0aa2cf16f420db7bcb87d4d995901`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:14.776752 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-544d60f6-8c2e-40c4-a2a6-1900fca23a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:14.786166 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 806/1623] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:14.798826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c14630-95b8-449c-a99d-a509e36e2212 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:14.814576 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c14630-95b8-449c-a99d-a509e36e2212 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:14.821392 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:14.822156 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:14.822435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:14.822947 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:14.835041 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:14.836634 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:14.849091 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 818/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:21.225494 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b946-fc29-4dc0-91e8-6c8cc236f190 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.226175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b946-fc29-4dc0-91e8-6c8cc236f190 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.226521 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b946-fc29-4dc0-91e8-6c8cc236f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.246739 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-c417b946-fc29-4dc0-91e8-6c8cc236f190 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:21.247923 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-c417b946-fc29-4dc0-91e8-6c8cc236f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:21.255565 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 807/1625] 10.222.0.25 () {58 vars in 967 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.300619 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.311437 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd660552-b645-493c-a8af-840b4d32f146 service nova] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.316833 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.317448 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.317725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.317992 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.325694 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.327261 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.335590 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 819/1626] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:42:21.805979 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18b6d-a8f1-41be-950e-09e5c2d50c06 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.806261 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18b6d-a8f1-41be-950e-09e5c2d50c06 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.806532 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18b6d-a8f1-41be-950e-09e5c2d50c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.826077 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-8aa18b6d-a8f1-41be-950e-09e5c2d50c06 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:21.827258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-8aa18b6d-a8f1-41be-950e-09e5c2d50c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:21.835147 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 808/1627] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.847127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66ad07-104b-4a46-8cb0-dd2a9d6350b8 service swift] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.865019 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.865623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.865901 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.866173 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.874131 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.875707 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90458d8-d7ad-4d64-aa16-d44fd3e59514 service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.884289 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 820/1628] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:42:30.149222 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.149767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.149864 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.168175 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] MFA Rules not processed for user `f0a9500fab2f4fbdb2d47604ed164fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:30.169383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.176119 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 809/1629] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:42:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:31.880976 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=18 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:34.971193 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216195-5a34-404e-ba3c-5371ba784c75 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:34.971767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216195-5a34-404e-ba3c-5371ba784c75 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:34.971767 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216195-5a34-404e-ba3c-5371ba784c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:34.990981 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-01216195-5a34-404e-ba3c-5371ba784c75 None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:34.992385 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-01216195-5a34-404e-ba3c-5371ba784c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:34.999556 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 821/1630] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:35.012136 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:35.023801 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4effb-0adf-4a01-900c-b4c51f5b311c None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:35.028773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:35.029401 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:35.029676 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:35.029944 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:35.038534 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:35.040051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:35.048066 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 810/1631] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:42:44.985494 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:45.044803 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=18 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:04.543295 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:04.543770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:04.543875 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:04.563449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:04.564672 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:04.572225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 822/1632] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:43:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:14.557788 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:18.232493 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.244556 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53f64-0168-47a0-bbb1-fcf471c651a2 service swift] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.249903 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.250486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.250761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.251032 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.258773 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.260364 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.269205 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 811/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:24.151885 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.164822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30b72-15a3-4f26-8890-74e96b1da5c1 None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.170308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.170940 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.171219 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.171488 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.179849 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.181447 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.190120 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 823/1634] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:28.264994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=6 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.114908 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.123929 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ec516-afcd-4406-a8d4-4fd2f19fe197 service nova] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.127665 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.128258 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.128535 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.139610 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.141040 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.151740 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 812/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:30.288759 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.297941 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f07b9-b06c-4b9e-898f-ca8482ecbad8 service nova] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.301523 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.302102 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.302374 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.302642 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.312342 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.313782 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.324550 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 824/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:39.147367 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=6 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:40.320099 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=12 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:09.040761 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:09.056056 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53f7d0-9c2e-49a8-b217-422f65b604a0 service neutron] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:09.065130 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de378f-4316-482b-b480-1856d960d027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:09.066985 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de378f-4316-482b-b480-1856d960d027 service nova] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:09.067516 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de378f-4316-482b-b480-1856d960d027 service nova] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:09.068013 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de378f-4316-482b-b480-1856d960d027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:09.082459 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de378f-4316-482b-b480-1856d960d027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:09.084746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de378f-4316-482b-b480-1856d960d027 service nova] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:09.099721 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 813/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:09.177031 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:09.195415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7caa4f-7b8f-446b-bca2-96cbeccaaee5 service neutron] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:09.199396 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:09.200164 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:09.200698 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:09.201180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:09.211439 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:09.213006 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:09.223363 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 825/1638] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:44:16.511169 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:16.511639 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:16.511715 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:16.532960 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] MFA Rules not processed for user `b9311a16e8a3495093739c1ce7c1e66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:16.534284 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:16.542023 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 814/1639] 10.222.0.25 () {58 vars in 967 bytes} [Fri Sep 30 09:44:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:16.586333 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:16.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc56ff3-c7dd-4ab8-b3bd-b9e90c38df5b service neutron] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:16.603291 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7c613ffbc6445296b63c1083ac8357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:16.603872 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:16.604147 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:16.604415 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:16.613007 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:16.614652 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e41d31-0e6c-46b6-b7fb-140e8bf31a37 service swift] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:16.622449 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 826/1640] 10.222.0.25 () {60 vars in 1384 bytes} [Fri Sep 30 09:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:44:16.970347 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:16.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59bc66-293e-49f6-afe1-782428ee988a None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:16.982885 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:16.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:16.983746 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:16.984015 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:17.044108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:17.045567 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165ff14-5e3e-43ef-bab6-bd6c514644a9 service neutron] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:17.055392 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 815/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:44:20.228931 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a27bb-99a7-4b66-a627-8be35821dfbb None None] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:20.229481 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a27bb-99a7-4b66-a627-8be35821dfbb None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:20.229780 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a27bb-99a7-4b66-a627-8be35821dfbb None None] PATH_INFO: `/` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:20.231591 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 827/1642] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:44:20.245404 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf72db-b071-45c4-9e44-517b8da44a9f None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:20.245977 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf72db-b071-45c4-9e44-517b8da44a9f None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:20.246108 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf72db-b071-45c4-9e44-517b8da44a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:20.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-2dbf72db-b071-45c4-9e44-517b8da44a9f None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:20.267970 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-2dbf72db-b071-45c4-9e44-517b8da44a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:20.276714 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 816/1643] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:44:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:20.293597 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a27bb-99a7-4b66-a627-8be35821dfbb None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:20.308822 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a27bb-99a7-4b66-a627-8be35821dfbb None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:20.323997 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:20.324641 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:20.324919 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:20.325186 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:20.334631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:20.336167 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aaad-a04f-436e-a029-fbe100f1d5e3 service placement] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:20.346826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 828/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:23.359679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb1ac-1683-4afa-886f-95dc65769e9e None None] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.360159 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb1ac-1683-4afa-886f-95dc65769e9e None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.360271 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fb1ac-1683-4afa-886f-95dc65769e9e None None] PATH_INFO: `/` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.367375 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 817/1645] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 30 09:44:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:44:23.397663 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] REQUEST_METHOD: `POST` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.398119 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.398331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.424435 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.auth.core [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] MFA Rules not processed for user `f526261ef68741719e636497d86446f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:23.425892 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:23.434954 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb1ac-1683-4afa-886f-95dc65769e9e None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.435334 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 829/1646] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 30 09:44:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:23.447458 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fb1ac-1683-4afa-886f-95dc65769e9e None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.453852 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.454484 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.454779 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.455126 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] PATH_INFO: `/v3/users/f0a9500fab2f4fbdb2d47604ed164fd1` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.456170 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a9500fab2f4fbdb2d47604ed164fd1)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.456293 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.458131 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.466861 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868240-79f3-477c-b3bb-b0c9735c8e6b None None] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.472442 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.473039 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.473354 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.473763 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.482308 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.484216 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.496739 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 830/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:44:23.511026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a9500fab2f4fbdb2d47604ed164fd1'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.511554 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a9500fab2f4fbdb2d47604ed164fd1'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.512263 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a9500fab2f4fbdb2d47604ed164fd1'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.520782 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a9500fab2f4fbdb2d47604ed164fd1'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.534897 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a9500fab2f4fbdb2d47604ed164fd1'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.547047 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 818/1648] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:23 2022] DELETE /identity/v3/users/f0a9500fab2f4fbdb2d47604ed164fd1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:23.714546 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.725835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14191d-dc83-4ea7-9d19-6513b73d0742 service placement] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.781245 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.781895 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.782177 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.783055 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] PATH_INFO: `/v3/projects/df96960447ef47b19f4bebcb732d93ea` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.784185 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df96960447ef47b19f4bebcb732d93ea)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.786157 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.831920 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df96960447ef47b19f4bebcb732d93ea', 'request_id': 'req-fd36db28-0f3d-4133-8a44-daf0d4f1c935'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.837387 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df96960447ef47b19f4bebcb732d93ea', 'request_id': 'req-fd36db28-0f3d-4133-8a44-daf0d4f1c935'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.844553 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df96960447ef47b19f4bebcb732d93ea', 'request_id': 'req-fd36db28-0f3d-4133-8a44-daf0d4f1c935'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.856272 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] The token cache is being invalidate because project df96960447ef47b19f4bebcb732d93ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:23.856561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.857195 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.858695 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 831/1649] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:23 2022] DELETE /identity/v3/projects/df96960447ef47b19f4bebcb732d93ea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:23.862767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.864139 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:23.876678 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c212-de83-44c6-a013-e9ad074c2fcd admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.914498 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:23.934486 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.935107 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.935654 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] PATH_INFO: `/v3/users/2a0a5b227d424b34b67136e45e26a832` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.936755 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0a5b227d424b34b67136e45e26a832)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.938731 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.984033 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0a5b227d424b34b67136e45e26a832'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.984722 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0a5b227d424b34b67136e45e26a832'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.985376 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0a5b227d424b34b67136e45e26a832'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:23.992511 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0a5b227d424b34b67136e45e26a832'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.004252 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-628e0bdd-92c8-46d0-9cf1-9a236fc2e7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0a5b227d424b34b67136e45e26a832'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.016448 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 819/1650] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:23 2022] DELETE /identity/v3/users/2a0a5b227d424b34b67136e45e26a832 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:24.194725 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:24.196306 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:24.213818 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36db28-0f3d-4133-8a44-daf0d4f1c935 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:24.242864 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:24.274160 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:24.274873 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:24.275151 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:24.275424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] PATH_INFO: `/v3/projects/b4aea277e33b42ffacad40e33ff38aca` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:24.276527 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4aea277e33b42ffacad40e33ff38aca)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:24.278466 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:24.323935 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4aea277e33b42ffacad40e33ff38aca', 'request_id': 'req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.330178 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4aea277e33b42ffacad40e33ff38aca', 'request_id': 'req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.337518 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4aea277e33b42ffacad40e33ff38aca', 'request_id': 'req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.348835 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] The token cache is being invalidate because project b4aea277e33b42ffacad40e33ff38aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:24.349127 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.349781 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:24.351260 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 832/1651] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:24 2022] DELETE /identity/v3/projects/b4aea277e33b42ffacad40e33ff38aca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:34.012717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:34.345676 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:05.995600 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] REQUEST_METHOD: `POST` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:05.996098 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:05.996197 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:06.015371 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.auth.core [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] MFA Rules not processed for user `ba6be524dfc54ac2a972f6e3ba2e601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:06.016813 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.069645 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 820/1652] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 30 09:45:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:06.392187 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:06.393770 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.450397 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22d9f-933b-4d95-a8cc-a0e15c52472d admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:06.453969 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:06.454582 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:06.455381 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:06.455666 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:06.457424 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.466544 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:06.467956 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:06.476138 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 833/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:06.907026 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:06.908433 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.977374 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92df78-a6b1-4d25-ad34-ae778620d9c3 None None] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:06.982165 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:06.982762 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:06.983038 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:06.983308 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:06.985002 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.996079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:06.997688 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:07.007672 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 821/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:16.472867 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=26 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:17.003718 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=57 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:18.644433 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:18.645896 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:18.721933 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeedd75-774e-4930-aad6-485aefc7010c service neutron] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:18.727375 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae0aa2cf16f420db7bcb87d4d995901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:18.727974 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:18.728254 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:18.728529 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:18.730269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:18.741751 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:18.743320 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:18.753335 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 834/1655] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:28.749288 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=34 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:31.808533 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:31.809987 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:31.890998 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b95f-f83a-40aa-b189-27b0a036dfe5 service placement] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:31.896212 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:31.896811 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:31.897087 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:31.897399 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:31.899064 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:31.910717 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:31.912314 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:31.922334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 822/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:41.917767 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=37 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:07.463798 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:07.499482 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df476-dda0-4183-bce6-4ac4a4f419cb service nova] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:07.504034 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d02936fe7de42d7a441bdb0e0d60fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:07.504623 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:07.504899 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:07.505168 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:07.506903 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:07.589967 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:07.591314 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:07.609230 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 835/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:47:13.684288 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:13.685846 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.708989 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c48450-13ab-439f-81f4-e9902c506254 service placement] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:13.713952 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:13.714575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.714856 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.715128 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] PATH_INFO: `/v3/users/ba6be524dfc54ac2a972f6e3ba2e601b` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.716255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6be524dfc54ac2a972f6e3ba2e601b)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:13.718334 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:13.764893 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6be524dfc54ac2a972f6e3ba2e601b'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.766255 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6be524dfc54ac2a972f6e3ba2e601b'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.766860 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6be524dfc54ac2a972f6e3ba2e601b'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.774079 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6be524dfc54ac2a972f6e3ba2e601b'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.786052 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6be524dfc54ac2a972f6e3ba2e601b'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.798051 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 823/1658] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:13 2022] DELETE /identity/v3/users/ba6be524dfc54ac2a972f6e3ba2e601b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:13.977561 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:13.990367 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eb4-4b5a-4ce6-9b0d-afda572f65d3 service neutron] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.046984 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.047603 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.047881 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.048225 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] PATH_INFO: `/v3/projects/db2023a4ff9446469b4e14aaffe850a0` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.049370 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2023a4ff9446469b4e14aaffe850a0)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.051269 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.090945 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:14.097648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2023a4ff9446469b4e14aaffe850a0', 'request_id': 'req-01685660-3652-45dd-8c1f-9ad496992d61'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.103331 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2023a4ff9446469b4e14aaffe850a0', 'request_id': 'req-01685660-3652-45dd-8c1f-9ad496992d61'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.110531 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2023a4ff9446469b4e14aaffe850a0', 'request_id': 'req-01685660-3652-45dd-8c1f-9ad496992d61'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.121614 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] The token cache is being invalidate because project db2023a4ff9446469b4e14aaffe850a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:14.121897 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.122519 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.123975 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 836/1659] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:13 2022] DELETE /identity/v3/projects/db2023a4ff9446469b4e14aaffe850a0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:14.128968 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:14.130920 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:14.145564 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab9f15-3a60-4e56-abdb-0dbcc947e254 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.216707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.217658 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.218072 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.218482 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] PATH_INFO: `/v3/users/90a39a98848d4158986a28c33a7ed129` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.220099 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a39a98848d4158986a28c33a7ed129)` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.223156 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.271251 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a39a98848d4158986a28c33a7ed129'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.271899 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a39a98848d4158986a28c33a7ed129'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.272505 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a39a98848d4158986a28c33a7ed129'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.279575 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a39a98848d4158986a28c33a7ed129'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.291898 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.notifications [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a39a98848d4158986a28c33a7ed129'} {{(pid=81493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.293841 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:14.306889 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 824/1660] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:14 2022] DELETE /identity/v3/users/90a39a98848d4158986a28c33a7ed129 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:14.477130 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Authenticating user token {{(pid=81494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:14.478660 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.fernet_utils [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:14.495121 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685660-3652-45dd-8c1f-9ad496992d61 admin admin] Validating token access rules against request {{(pid=81494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.554549 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '747baf23ba054f8aad78324c55ee7740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb557875fa6e42b4902cd1a1d7e26a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.555180 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.555462 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.555740 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] PATH_INFO: `/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9` {{(pid=81494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.556868 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524e04e4f28b45fe9acf4b28a48d3ff9)` {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.558826 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] RBAC: Authorization granted {{(pid=81494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.603648 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524e04e4f28b45fe9acf4b28a48d3ff9', 'request_id': 'req-0a900328-899a-4ade-9975-44bcdd7e3288'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.610187 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524e04e4f28b45fe9acf4b28a48d3ff9', 'request_id': 'req-0a900328-899a-4ade-9975-44bcdd7e3288'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.617398 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524e04e4f28b45fe9acf4b28a48d3ff9', 'request_id': 'req-0a900328-899a-4ade-9975-44bcdd7e3288'} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.628709 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] The token cache is being invalidate because project 524e04e4f28b45fe9acf4b28a48d3ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:14.628996 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.629631 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG keystone.notifications [None req-0a900328-899a-4ade-9975-44bcdd7e3288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.631105 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: [pid: 81494|app: 0|req: 837/1661] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:14 2022] DELETE /identity/v3/projects/524e04e4f28b45fe9acf4b28a48d3ff9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:24.307419 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG dbcounter [-] [81493] Writing DB stats keystone:SELECT=4 {{(pid=81493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:24.626391 dv-osbrick-master-4-iscsi devstack@keystone.service[81494]: DEBUG dbcounter [-] [81494] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:38.793144 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Authenticating user token {{(pid=81493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:38.795057 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:38.862269 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2589d-9cd6-4586-a533-7e58f6e41750 admin admin] Validating token access rules against request {{(pid=81493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:38.920479 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f526261ef68741719e636497d86446f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd00ee2cb812c4f5195baea411a6f0e4e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:38.921080 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] REQUEST_METHOD: `GET` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:38.921411 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:38.921679 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:38.923351 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.fernet_utils [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:38.934137 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:38.935707 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1da1b-c134-4921-b3c3-3184ec633cd4 service placement] RBAC: Authorization granted {{(pid=81493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:38.944994 dv-osbrick-master-4-iscsi devstack@keystone.service[81493]: [pid: 81493|app: 0|req: 825/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)